-- Logs begin at Thu 2022-06-02 09:21:19 UTC, end at Thu 2022-06-02 10:37:20 UTC. -- Jun 02 10:04:02.156471 dv-cinder-797608-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 10:04:02.165329 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 10:04:02 2022] *** Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: nodename: dv-cinder-797608-25-iscsi Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: machine: x86_64 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: clock source: unix Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: pcre jit disabled Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: detected number of CPU cores: 4 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: current working directory: / Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: detected binary path: /usr/bin/uwsgi-core Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: your processes number limit is 47680 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: your memory page size is 4096 bytes Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: detected max file descriptor number: 2048 Jun 02 10:04:02.167324 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: lock engine: pthread robust mutexes Jun 02 10:04:02.173115 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: thunder lock: enabled Jun 02 10:04:02.173115 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 10:04:02.173115 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 10:04:02.211514 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: Python main interpreter initialized at 0x56079687e9c0 Jun 02 10:04:02.211514 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: python threads support enabled Jun 02 10:04:02.211514 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: your server socket listen backlog is limited to 100 connections Jun 02 10:04:02.211514 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: your mercy for graceful operations on workers is 90 seconds Jun 02 10:04:02.211866 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 10:04:02.211954 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: *** Operational MODE: preforking *** Jun 02 10:04:02.212173 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: *** uWSGI is running in multiple interpreter mode *** Jun 02 10:04:02.212173 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: spawned uWSGI master process (pid: 103652) Jun 02 10:04:02.212360 dv-cinder-797608-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 10:04:02.219526 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: spawned uWSGI worker 1 (pid: 103653, cores: 1) Jun 02 10:04:02.219526 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: spawned uWSGI worker 2 (pid: 103654, cores: 1) Jun 02 10:04:02.219526 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 10:04:03.425621 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 10:04:03.435987 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 10:04:04.145474 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:04:04.145474 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: from cryptography.utils import int_from_bytes Jun 02 10:04:04.145812 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:04:04.145812 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: from cryptography.utils import int_from_bytes Jun 02 10:04:04.146988 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:04:04.146988 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: from cryptography.utils import int_from_bytes Jun 02 10:04:04.147355 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:04:04.147355 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: from cryptography.utils import int_from_bytes Jun 02 10:04:06.760496 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 10:04:06.761058 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 10:04:06.761262 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 10:04:06.761626 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 10:04:06.761807 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 10:04:06.762193 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 10:04:06.762278 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 10:04:06.762357 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.762569 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.762667 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 10:04:06.762888 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.763495 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 10:04:06.763698 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 10:04:06.763795 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764057 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764167 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764376 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764464 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764713 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.764813 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765020 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765128 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765348 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765441 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765610 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765706 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.765935 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766021 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766264 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-25-iscsi {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766356 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766590 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766685 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766849 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.766934 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767196 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767287 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767526 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-25-iscsi {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767622 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767830 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.767916 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768144 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768237 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768450 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768534 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768770 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.768944 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.769078 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.769390 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.769501 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.769699 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.769818 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770016 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770190 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770352 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770507 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770683 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770802 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.770948 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771139 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771301 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771485 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771605 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771822 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.771957 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772104 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772220 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772422 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772571 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-25-iscsi {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772723 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.772892 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773068 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773189 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773359 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773524 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773774 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-25-iscsi {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.773903 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774079 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774237 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774399 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774558 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774718 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.774843 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775122 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775216 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775426 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775515 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775737 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.775839 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776062 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776156 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776381 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776472 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776695 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776781 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.776996 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777080 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777307 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777399 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777618 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777737 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.777938 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.778024 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.778242 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.778327 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779157 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779253 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779424 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779511 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779737 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.779823 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780064 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780152 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780560 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780709 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780850 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.780988 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781119 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781243 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781366 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781489 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781626 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781776 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.781904 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782084 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782210 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782346 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782483 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782643 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782771 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.782967 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783143 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783283 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783406 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783590 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783725 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.783896 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784031 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784200 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784326 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784505 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784642 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784816 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.784951 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785125 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785262 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785430 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785555 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785747 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.785883 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786066 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786226 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786518 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786695 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.786837 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787017 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787161 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787389 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787516 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787686 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787824 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.787998 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788126 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788317 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788445 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788626 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788754 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.788935 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789068 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789243 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789379 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789564 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789697 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.789876 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790009 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790177 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790309 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790441 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790577 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790772 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.790898 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791023 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791192 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791326 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791449 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791628 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791754 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.791935 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792076 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792241 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792368 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792543 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792669 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792849 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.792984 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793156 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793288 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793459 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793591 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793760 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.793894 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794064 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794221 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794441 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794602 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794734 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.794872 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795004 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795156 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795284 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795415 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795592 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795721 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.795902 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796029 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796211 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796340 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796519 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796646 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796823 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.796963 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797130 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797259 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797444 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797576 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797748 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.797879 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798054 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798189 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798364 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798498 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798665 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798791 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.798972 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799158 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799309 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799435 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799612 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799737 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.799916 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800048 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800227 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800355 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800524 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800650 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800852 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.800986 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801141 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801269 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801447 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801575 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801749 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.801875 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802049 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802176 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802353 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802489 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802656 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802791 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.802961 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803087 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803288 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803425 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803594 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.803896 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804024 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804198 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804332 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804504 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804645 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804809 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.804935 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805108 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805226 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805407 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805551 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805728 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.805863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.806036 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.806169 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.806375 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.806507 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.806639 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.806764 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.806952 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:04:06.807079 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.807314 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.807443 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.807652 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.807781 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.807980 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808105 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808295 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808422 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808610 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808750 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.808938 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809075 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809252 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809378 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809564 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809691 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.809912 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810057 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810235 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810362 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810554 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810680 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.810867 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811074 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811226 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811380 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811516 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811640 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811817 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.811959 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812127 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812252 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812447 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812580 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812765 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.812900 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813087 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813214 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813399 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813532 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813716 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.813854 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814048 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814176 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814371 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814496 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814684 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.814817 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815007 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815253 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815384 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815519 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815654 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815779 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.815951 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816078 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816274 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816401 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816607 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816735 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.816922 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817056 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817238 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817365 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817547 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817674 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817861 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.817988 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818173 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818310 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818484 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818619 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818796 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.818924 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819129 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819272 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819449 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819576 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819762 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.819887 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820074 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820209 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820388 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820515 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820702 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.820829 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821015 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821226 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821357 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821488 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821620 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821744 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.821908 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822045 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822214 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822341 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822525 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822672 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822816 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.822946 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823147 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823289 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823463 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823593 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823775 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.823902 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824081 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824206 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824538 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824717 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.824846 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.825029 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.825156 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.825342 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.825991 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826177 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826305 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826497 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826625 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826807 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.826942 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827140 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827284 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827453 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827580 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827763 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.827898 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828072 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828199 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828380 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828507 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828691 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828831 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.828999 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829127 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829305 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829433 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829615 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829818 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.829953 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830077 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830207 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830338 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830516 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830652 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830827 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.830964 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831162 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831365 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831506 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831630 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831781 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.831908 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832108 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832236 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832412 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832538 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832729 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.832860 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833049 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833175 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833369 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833501 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833675 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833809 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.833986 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834122 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834292 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834420 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834598 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834725 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.834904 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835041 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835239 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835367 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835546 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835672 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835848 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.835991 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836153 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836279 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836461 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836586 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836767 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.836901 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837083 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837211 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837390 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837516 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837694 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837822 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.837995 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838122 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838299 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838426 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838615 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838751 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.838925 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839060 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839260 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839390 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839570 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839699 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.839915 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840041 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840223 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840358 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840541 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840667 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840857 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.840995 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.841771 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.841917 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842103 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842240 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842417 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842550 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842731 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.842872 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843043 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843204 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843381 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843508 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843695 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.843839 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844131 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844326 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844454 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844636 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844774 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.844956 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845091 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845258 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845383 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845576 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845712 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.845886 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846019 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846209 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846348 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846520 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846650 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846841 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.846978 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847163 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847299 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847478 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847607 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847791 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.847918 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848103 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848231 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848414 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848726 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.848853 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849046 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849180 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849353 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849479 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849662 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849796 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.849970 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850105 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850290 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850416 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850597 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850725 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.850917 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851055 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851244 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851382 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851561 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851689 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.851892 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852033 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852187 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852315 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852497 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852624 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.852896 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.853218 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.853539 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.853539 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.853982 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854105 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854235 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854359 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854482 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854604 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854726 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.854898 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855035 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855228 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855355 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855535 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855663 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855847 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.855985 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856153 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856274 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856618 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856818 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.856956 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857126 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857254 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857434 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857572 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857750 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.857888 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858073 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858210 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858379 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858505 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858700 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.858826 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859009 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859166 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859340 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859468 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859669 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859793 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.859953 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860079 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860260 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860387 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860566 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860694 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860872 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.860999 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861178 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861300 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861501 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861635 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861814 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.861963 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862151 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862287 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862412 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862724 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.862859 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863030 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863209 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863368 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863496 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863677 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863804 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.863989 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864130 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864317 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864446 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864635 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864762 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.864950 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865083 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865266 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865393 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865575 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865710 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.865887 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866014 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866195 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866320 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866519 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866645 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866827 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.866953 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867159 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867290 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867473 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867606 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867781 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.867910 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868093 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868227 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868407 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868542 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868734 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.868978 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.869105 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.869311 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.869438 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.869629 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.869758 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870206 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870345 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870522 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870658 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870839 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.870966 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.871194 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.871434 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.871563 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.871774 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.871910 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872096 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872326 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872488 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872615 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872798 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.872935 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873107 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873243 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873421 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873549 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873729 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.873858 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874035 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874171 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874342 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874480 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874648 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874783 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.874943 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875080 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875274 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875402 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875581 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875708 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.875888 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876030 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876199 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876327 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876508 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876643 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876819 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.876948 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877122 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877248 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877428 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877562 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877740 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.877876 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878042 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878169 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878346 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878474 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878651 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878777 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.878967 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879154 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879297 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879422 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879616 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879752 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.879931 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880059 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880240 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880377 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880548 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880676 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880851 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.880977 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881177 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881314 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881482 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881610 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881789 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.881955 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882082 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882242 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882447 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882582 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882707 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.882888 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883029 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883224 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883355 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883554 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883685 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.883864 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884074 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884202 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884326 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884448 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884571 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884748 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.884889 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885053 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885194 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885359 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885492 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885665 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885800 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.885971 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886098 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886277 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886409 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886588 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886715 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.886893 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887026 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887223 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887353 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887529 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887657 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.887828 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.888462 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.888664 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.888791 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.888969 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889097 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889306 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889434 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889613 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889742 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.889926 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890069 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890236 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890368 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890540 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890678 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890858 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.890984 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891188 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891328 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891497 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891636 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891802 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.891929 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892108 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892242 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892435 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892652 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892808 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.892939 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893062 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893186 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893310 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893443 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893618 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893747 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.893923 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894051 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894234 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894370 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894537 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894666 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894840 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.894968 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895157 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895298 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895463 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895592 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895769 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.895898 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896073 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896209 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896377 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896504 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896681 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896808 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.896992 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897121 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897305 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897433 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897610 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897746 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.897915 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898050 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898219 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898354 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898524 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898660 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898828 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.898956 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899162 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899304 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899473 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899611 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899803 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.899931 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900114 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900240 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900420 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900556 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900731 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.900859 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901039 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901168 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901350 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901488 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901658 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901785 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.901973 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902101 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902284 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902405 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902597 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902799 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.902927 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.903050 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.903235 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.903362 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.903550 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.904187 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.904446 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.904575 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.904761 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.904889 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905084 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905211 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905404 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905538 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905723 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.905859 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906025 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906151 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906332 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906471 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906640 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906767 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.906957 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907084 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907295 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907434 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907606 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907731 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.907920 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908048 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908236 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908676 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908852 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.908981 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909162 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909465 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909593 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909776 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.909902 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910083 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910209 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910389 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910525 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910700 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.910826 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911009 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911177 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911339 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911467 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911650 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911785 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.911956 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912084 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912267 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912392 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912569 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912708 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.912924 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913052 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913216 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913352 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913530 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913735 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913869 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.913994 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914138 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914267 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914448 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914584 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914760 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.914888 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915065 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915213 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915397 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915542 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915817 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.915965 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916132 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916261 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916439 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916573 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916746 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.916873 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917058 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917183 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917359 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917487 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917668 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917796 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.917984 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918110 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918285 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918411 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918590 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918718 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.918897 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919025 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919271 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919410 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919583 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919711 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.919907 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920036 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920244 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920371 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920574 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920703 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.920885 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921023 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921214 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921343 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921524 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921659 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921852 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.921993 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.922163 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.922291 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.922489 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.922616 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.922824 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923043 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923199 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923340 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923466 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923589 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923750 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.923937 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924069 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924253 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924389 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924569 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924778 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.924905 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925031 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925210 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925347 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925539 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925674 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925848 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.925989 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926167 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926482 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926610 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926810 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.926951 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927159 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927316 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927482 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927611 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927800 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.927938 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928108 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928236 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928435 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928564 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928738 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.928874 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929050 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929178 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929357 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929487 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929663 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929792 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.929985 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930114 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930291 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930421 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930601 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930738 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.930910 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931039 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931244 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931383 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931550 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931687 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931856 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.931984 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932177 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932306 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932481 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932618 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932806 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.932940 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933140 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933277 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933417 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933543 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933714 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.933842 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934023 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934159 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934330 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934457 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934639 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934809 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.934947 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935080 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935284 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935425 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935591 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935721 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.935923 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936060 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936231 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936358 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936556 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936685 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936861 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.936989 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937186 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937316 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937502 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937630 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937805 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.937940 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938111 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938239 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938420 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938561 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938761 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.938890 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939068 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939213 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939405 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939550 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939712 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.939852 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940023 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940151 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940330 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940460 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940637 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940765 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.940943 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941078 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941252 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941389 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941558 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941694 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941861 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.941998 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942166 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942307 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942488 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942617 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942796 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.942924 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943151 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943295 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943443 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943570 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943748 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.943883 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944050 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944179 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944354 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944481 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944661 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944791 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.944968 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945098 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945429 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945601 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945729 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.945919 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946046 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946227 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946354 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946537 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946673 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946845 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.946975 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947244 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947393 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947520 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947657 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947782 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.947906 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948090 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948219 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948406 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948544 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948720 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.948855 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949034 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949163 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949345 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949482 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949660 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949788 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.949974 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.950101 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.950288 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.950924 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951142 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951338 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951468 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951672 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951815 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.951991 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952118 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952306 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952442 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952621 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952762 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.952936 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953064 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953248 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953376 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953561 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953761 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.953889 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954089 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954224 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954423 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954553 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954744 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.954873 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955066 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955246 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955411 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955549 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.955860 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956047 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956182 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956361 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956535 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956671 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956796 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.956973 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957101 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957287 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957423 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957626 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957763 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.957929 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958067 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958245 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958376 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958560 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958696 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.958874 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959002 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959211 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959349 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959524 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959653 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959837 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.959974 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960151 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960279 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960464 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960593 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960776 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.960914 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961090 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961401 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961527 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961716 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.961843 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962032 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962161 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962348 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962658 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962786 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.962971 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963135 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963311 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963431 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963621 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963831 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.963961 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964147 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964277 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964481 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964610 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964808 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.964935 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965134 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965262 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965450 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965579 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965770 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.965906 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.967585 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.967730 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.967882 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968010 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968136 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968260 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968629 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968755 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.968879 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969010 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969135 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969269 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969402 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969534 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969659 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969790 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.969916 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970048 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970181 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970181 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970416 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970542 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970673 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970811 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.970938 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971069 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971255 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971391 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971527 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971661 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971786 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.971909 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.972072 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.972200 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.972400 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.972530 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.972711 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973022 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973144 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973337 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973474 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973654 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973790 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.973965 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974093 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974273 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974411 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974586 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974734 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.974897 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975033 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975226 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975369 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975540 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975668 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975848 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.975976 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976176 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976313 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976486 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976623 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976795 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.976921 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977098 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977226 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977415 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977722 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.977851 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978030 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978164 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978333 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978461 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978637 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978766 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.978948 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979077 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979280 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979409 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979590 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979732 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.979894 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980028 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980207 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980335 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980513 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980650 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980824 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.980952 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981130 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981258 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981442 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981580 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981786 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.981917 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982094 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982223 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982403 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982539 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982713 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.982847 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983024 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983167 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983366 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983493 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983661 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.983789 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984004 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984132 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984322 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984452 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984629 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984859 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.984990 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985201 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985338 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985527 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985655 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985854 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.985982 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986172 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986340 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986468 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986591 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986780 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.986907 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.987135 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.987267 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.987446 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.987679 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.987808 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988019 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988161 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988346 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988474 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988657 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988784 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.988970 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989106 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989285 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989412 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989597 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989725 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.989906 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990041 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990215 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990341 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990527 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990661 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990838 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.990966 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991172 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991302 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991486 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991611 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991800 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.991928 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992116 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992243 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992432 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992559 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992746 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.992875 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993060 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993188 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993375 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993513 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993687 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993817 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.993997 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.994123 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.994309 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.994445 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.994619 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.994745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995217 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995351 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995553 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995700 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995872 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.995999 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996182 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996310 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996503 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996630 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996820 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.996949 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997145 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997300 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997489 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997626 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997808 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.997937 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998131 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998258 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998456 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998585 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998769 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.998898 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999076 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999235 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999417 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999749 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:06.999877 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000089 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000227 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000423 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000550 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000747 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.000881 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001052 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001188 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001361 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001488 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001670 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001798 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.001981 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002109 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002295 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002421 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002605 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002731 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.002914 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003042 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003230 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003364 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003548 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003676 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003857 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.003986 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004166 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004304 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004475 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004603 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004786 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.004923 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005098 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005225 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005406 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005709 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.005836 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006013 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006139 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006323 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006463 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006633 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006767 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.006936 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007070 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007270 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007411 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007579 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007707 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.007893 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008023 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008202 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008339 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008510 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008639 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008812 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.008939 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009116 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009244 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009424 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009564 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009731 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.009872 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010043 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010174 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010352 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010481 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010708 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010844 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.010982 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011161 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011301 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011427 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011581 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011717 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.011917 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.012046 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.012226 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.012353 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.012562 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.012761 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.013424 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.013574 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.013707 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.013832 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014000 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014137 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014315 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014453 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014628 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014763 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.014941 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015078 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015286 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015414 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015602 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015731 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.015909 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016036 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016238 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016366 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016551 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016686 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016866 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.016995 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017181 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017307 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017492 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017618 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017813 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.017943 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018124 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018258 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018440 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018587 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018752 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.018878 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019063 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019219 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019400 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019721 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.019855 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020035 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020161 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020345 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020481 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020680 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020809 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.020989 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021116 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021301 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021437 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021622 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021758 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.021939 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022075 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022256 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022577 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022715 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.022898 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023036 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023237 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023366 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023554 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023676 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023862 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.023990 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.024123 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 10:04:07.024249 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.024504 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.024857 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.025174 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.025520 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.025853 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.026175 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.026490 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.026802 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:04:07.027049 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103653) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 10:04:07.083377 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Registered counter for database nova_api Jun 02 10:04:07.086312 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO dbcounter [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Registered counter for database nova_api Jun 02 10:04:07.103969 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.106175 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_db.sqlalchemy.engines [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.111957 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.114163 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writer thread running {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.168773 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.context [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb173f29-3e1b-4df6-96a9-19c3d8f141fb(cell1) {{(pid=103654) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 10:04:07.171821 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.context [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb173f29-3e1b-4df6-96a9-19c3d8f141fb(cell1) {{(pid=103653) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 10:04:07.173492 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:04:07.175054 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:04:07.175874 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:04:07.176028 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:04:07.177593 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:04:07.177814 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:04:07.178458 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:04:07.179820 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Registered counter for database nova_cell0 Jun 02 10:04:07.180463 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:04:07.182444 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO dbcounter [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Registered counter for database nova_cell0 Jun 02 10:04:07.183852 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Registered counter for database nova_cell1 Jun 02 10:04:07.186408 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO dbcounter [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Registered counter for database nova_cell1 Jun 02 10:04:07.191294 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.192574 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.194442 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_db.sqlalchemy.engines [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.196777 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_db.sqlalchemy.engines [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.200454 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.201995 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writer thread running {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.202516 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.204509 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writer thread running {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.350122 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Registered counter for database nova_cell0 Jun 02 10:04:07.351658 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO dbcounter [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Registered counter for database nova_cell0 Jun 02 10:04:07.359079 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.362141 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_db.sqlalchemy.engines [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103653) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:04:07.363790 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.366581 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writer thread running {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:04:07.921180 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: WARNING keystonemiddleware.auth_token [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:04:07.928492 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: WARNING keystonemiddleware.auth_token [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:04:07.942392 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:04:07.949662 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:04:08.150426 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: WARNING keystonemiddleware.auth_token [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:04:08.156893 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: WARNING keystonemiddleware.auth_token [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:04:08.162050 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56079687e9c0 pid: 103653 (default app) Jun 02 10:04:08.164389 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:04:08.165582 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 02 10:04:08.166012 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Thu Jun 2 10:04:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:04:08.172324 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:04:08.178271 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-5b1fbedd-4648-4030-ae61-ebbe31055095 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:04:08.183421 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56079687e9c0 pid: 103654 (default app) Jun 02 10:05:28.442932 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:28.443976 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 02 10:05:28.444372 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:28.456461 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:28.457644 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell0:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:28.458500 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell1:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:28.459555 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:28.893539 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-d0a0076c-7d90-4c3a-97ab-be32ca763ad6 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:28.925795 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-d0a0076c-7d90-4c3a-97ab-be32ca763ad6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.474424 Jun 02 10:05:28.926664 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 2 10:05:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:31.213967 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:31.214995 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-105b9f6c-e70e-40f0-b5b5-8ebc629fde86 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Jun 02 10:05:31.215406 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:31.284790 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-3ac30e75-b25c-4c52-9325-8763e1613bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:31.304888 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:05:31.304888 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: warnings.warn(msg) Jun 02 10:05:31.390307 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-3ac30e75-b25c-4c52-9325-8763e1613bab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.168900 Jun 02 10:05:31.397747 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:31.404846 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_api:SELECT=3 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:31.405693 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_cell1:SELECT=3 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:31.407269 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_cell0:SELECT=3 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:31.408034 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:31.611552 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-9f37dead-1252-45e5-b542-a432a434d602 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:31.613956 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:05:31.613956 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:05:31.766539 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-9f37dead-1252-45e5-b542-a432a434d602 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.367475 Jun 02 10:05:31.768284 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 2 10:05:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:34.050897 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-3ac30e75-b25c-4c52-9325-8763e1613bab admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:34.051893 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-3ac30e75-b25c-4c52-9325-8763e1613bab admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 02 10:05:34.052311 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:34.156550 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-954ffe74-862d-4c6d-b587-bde167eb2791 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:34.174354 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:05:34.174354 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:05:34.302204 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-954ffe74-862d-4c6d-b587-bde167eb2791 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.243554 Jun 02 10:05:34.303464 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:34.316672 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-26955c08-ecad-46c7-921c-39e341267986 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:34.318144 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:05:34.318144 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: warnings.warn(msg) Jun 02 10:05:34.431926 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-26955c08-ecad-46c7-921c-39e341267986 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119203 Jun 02 10:05:34.433635 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 2 10:05:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:36.731580 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-954ffe74-862d-4c6d-b587-bde167eb2791 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:36.732757 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-954ffe74-862d-4c6d-b587-bde167eb2791 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jun 02 10:05:36.733347 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:36.797984 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-667898cf-490d-4b31-aefe-dbaed2689c9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:36.867371 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-667898cf-490d-4b31-aefe-dbaed2689c9d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.127903 Jun 02 10:05:36.868085 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:36.881170 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-558056da-e4b6-49d5-bf1b-d793b7a18281 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:36.962548 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-558056da-e4b6-49d5-bf1b-d793b7a18281 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085265 Jun 02 10:05:36.963387 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 2 10:05:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:05:39.249415 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-667898cf-490d-4b31-aefe-dbaed2689c9d admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:39.250433 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-667898cf-490d-4b31-aefe-dbaed2689c9d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 02 10:05:39.250849 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:39.316795 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-328ca5bc-70dd-4b17-ba0b-c09609dc5ccd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "disk": 10, "name": "ds2G"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:39.392074 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-328ca5bc-70dd-4b17-ba0b-c09609dc5ccd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132371 Jun 02 10:05:39.392742 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:39.405221 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-0f32967b-357a-4ad4-bbab-d018a1bc21ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:39.563034 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-0f32967b-357a-4ad4-bbab-d018a1bc21ee admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161265 Jun 02 10:05:39.564081 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 2 10:05:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:41.874803 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-328ca5bc-70dd-4b17-ba0b-c09609dc5ccd admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:41.875873 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-328ca5bc-70dd-4b17-ba0b-c09609dc5ccd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 02 10:05:41.876275 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:41.934382 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "swap": 0}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:42.003308 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120919 Jun 02 10:05:42.003865 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:42.016631 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-01e300d3-88d2-458f-96a5-d307c7ac6fa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:42.092782 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-01e300d3-88d2-458f-96a5-d307c7ac6fa8 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079826 Jun 02 10:05:42.093277 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 2 10:05:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:44.403355 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:44.404382 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 02 10:05:44.404791 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:44.464089 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-861c05d1-6c8b-4302-b3db-b6fe27e71667 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:44.488837 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-861c05d1-6c8b-4302-b3db-b6fe27e71667 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077804 Jun 02 10:05:44.489505 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 2 10:05:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:05:46.941285 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:46.942337 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-6e92717f-d92a-46ea-8ebd-f48cb9942a58 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 02 10:05:46.943002 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:47.022171 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-47e28554-52fc-45ba-99df-11101106663e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:47.083969 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-47e28554-52fc-45ba-99df-11101106663e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.135301 Jun 02 10:05:47.084486 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:47.097061 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-501b5b48-cf73-403e-bb42-33b9766e61b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:47.178852 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-501b5b48-cf73-403e-bb42-33b9766e61b7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085506 Jun 02 10:05:47.179376 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 2 10:05:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:49.474860 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-47e28554-52fc-45ba-99df-11101106663e admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:49.475981 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-47e28554-52fc-45ba-99df-11101106663e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 02 10:05:49.476408 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:49.540767 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-5a517c36-8a88-470f-89bc-771fc51916cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:49.618267 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-5a517c36-8a88-470f-89bc-771fc51916cc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134526 Jun 02 10:05:49.622468 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:05:49.631930 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-ae2c2274-26b0-46f7-ac9c-f257e3a343bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:49.720791 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-ae2c2274-26b0-46f7-ac9c-f257e3a343bc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092583 Jun 02 10:05:49.721912 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 2 10:05:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:52.005811 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-5a517c36-8a88-470f-89bc-771fc51916cc admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:52.006833 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-5a517c36-8a88-470f-89bc-771fc51916cc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 02 10:05:52.007421 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:52.064748 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-0eae8d4f-2f03-4f9c-a93d-7a110b7c7c8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "disk": 40, "vcpus": 2, "ram": 4096}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:52.146079 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-0eae8d4f-2f03-4f9c-a93d-7a110b7c7c8e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132668 Jun 02 10:05:52.146651 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:52.158256 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-469c6444-0f15-4144-a513-009d36c1d579 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:52.235455 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-469c6444-0f15-4144-a513-009d36c1d579 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080682 Jun 02 10:05:52.236028 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 2 10:05:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:54.495259 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-0eae8d4f-2f03-4f9c-a93d-7a110b7c7c8e admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:54.497308 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-0eae8d4f-2f03-4f9c-a93d-7a110b7c7c8e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 02 10:05:54.497308 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:54.555349 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-182c0a87-3791-4dd1-8192-c83677df050f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:54.620618 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-182c0a87-3791-4dd1-8192-c83677df050f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.118070 Jun 02 10:05:54.621180 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:05:54.633506 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-2a6f409b-48c6-4fd7-9700-53cca96e7e55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:54.733457 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-2a6f409b-48c6-4fd7-9700-53cca96e7e55 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103670 Jun 02 10:05:54.733956 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 2 10:05:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:05:57.142592 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-182c0a87-3791-4dd1-8192-c83677df050f admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:05:57.144462 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-182c0a87-3791-4dd1-8192-c83677df050f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002354 Jun 02 10:05:57.144959 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:05:57.216788 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:57.585553 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.434017 Jun 02 10:05:57.588328 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 2 10:05:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:05:57.600417 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-7bb7e89b-edda-459f-ad00-1be1f4b551ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:05:57.670487 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-7bb7e89b-edda-459f-ad00-1be1f4b551ec admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074087 Jun 02 10:05:57.671109 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 2 10:05:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:06:22.092543 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:22.093557 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 02 10:06:22.093965 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:22.105833 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:22.155439 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-a6b83639-6f82-40fa-a26e-accc680027d5 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:22.173253 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-a6b83639-6f82-40fa-a26e-accc680027d5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071940 Jun 02 10:06:22.173776 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 2 10:06:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:06:23.156778 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:23.157790 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-6c7a78c4-c563-4119-b417-873c31b72ce2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 02 10:06:23.158189 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:23.357756 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-90474997-c4c1-4297-bf78-ea7eba25c529 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:23.363258 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-90474997-c4c1-4297-bf78-ea7eba25c529 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-90474997-c4c1-4297-bf78-ea7eba25c529 admin admin] Request method failure captured: Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept: application/json Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Connection: keep-alive Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Content-Length: 0 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Host: 10.222.0.13 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABimIufZvue6GrZzcCqsxuEplJuPWXw3a3tjIIcbVdo_xdC5dRwv5WgdYHNLywdzLmLMbLmxoCAAe2J4CJtuZmb69yEht7pj_5jx-kaeIzb2-uMu37bYbnDASCRapVrnHLQRdGRk1-9Vg98x_2HzjXi8oIW55JFQGO1cMDmvvsJpleXe90 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Id: None Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Name: None Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Name: admin Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Role: reader,admin,member Jun 02 10:06:23.366476 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Roles: reader,admin,member Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant: admin Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User: admin Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Name: admin Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: method: > Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: exception: Flavor 42 could not be found. Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: action_args: {'id': '42'} Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:23.368913 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:23.369866 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-90474997-c4c1-4297-bf78-ea7eba25c529 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:23.372074 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-90474997-c4c1-4297-bf78-ea7eba25c529 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062356 Jun 02 10:06:23.372074 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 2 10:06:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:23.378458 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-e0ba3886-bc57-4df6-8835-597891f7d0ad admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:23.381461 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:23.400876 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-e0ba3886-bc57-4df6-8835-597891f7d0ad admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025994 Jun 02 10:06:23.401412 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:06:23.411275 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-dd4f0339-ea80-47aa-8f78-6c093f8c8826 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:23.432873 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-dd4f0339-ea80-47aa-8f78-6c093f8c8826 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025280 Jun 02 10:06:23.433397 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:06:23.442907 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-057c3efa-74f5-4253-baf4-47423533d095 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:23.449578 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.wsgi [None req-057c3efa-74f5-4253-baf4-47423533d095 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-057c3efa-74f5-4253-baf4-47423533d095 admin admin] Request method failure captured: Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept: application/json Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept-Encoding: gzip, deflate Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Connection: keep-alive Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Content-Length: 0 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Host: 10.222.0.13 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-System-Scope: None Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: User-Agent: python-novaclient Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Auth-Token: gAAAAABimIufZvue6GrZzcCqsxuEplJuPWXw3a3tjIIcbVdo_xdC5dRwv5WgdYHNLywdzLmLMbLmxoCAAe2J4CJtuZmb69yEht7pj_5jx-kaeIzb2-uMu37bYbnDASCRapVrnHLQRdGRk1-9Vg98x_2HzjXi8oIW55JFQGO1cMDmvvsJpleXe90 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Id: None Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Name: None Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Identity-Status: Confirmed Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Is-Admin-Project: True Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Id: default Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Name: Default Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Name: admin Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Role: reader,admin,member Jun 02 10:06:23.462099 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Roles: reader,admin,member Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant: admin Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Name: admin Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User: admin Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Id: default Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Name: Default Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Name: admin Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: method: > Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: exception: Flavor 42 could not be found. Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: action_args: {'id': '42'} Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:23.463732 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:23.464743 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:23.466001 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-057c3efa-74f5-4253-baf4-47423533d095 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:23.467307 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-057c3efa-74f5-4253-baf4-47423533d095 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015182 Jun 02 10:06:23.467307 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 2 10:06:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:24.309548 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-dd4f0339-ea80-47aa-8f78-6c093f8c8826 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:24.310556 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-dd4f0339-ea80-47aa-8f78-6c093f8c8826 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 02 10:06:24.310949 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:24.498376 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-7fac3e86-9d83-497c-954f-944bf3592fc5 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:24.503812 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.wsgi [None req-7fac3e86-9d83-497c-954f-944bf3592fc5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-7fac3e86-9d83-497c-954f-944bf3592fc5 admin admin] Request method failure captured: Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept: application/json Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept-Encoding: gzip, deflate Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Connection: keep-alive Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Content-Length: 0 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Host: 10.222.0.13 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-System-Scope: None Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: User-Agent: python-novaclient Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Auth-Token: gAAAAABimIugzdc5sV7upDa9T1gme7bhLCwsleHJnNOP44d3duMX38WLZRHuPG_q3r9IBLQzgksWQghZ2sanIAAaikYSCCshmEewFPhQ250_UsvaFAtc-Si3K-gJAbqBcWrE5wsVEwLTXEa0E_8ZGTkfCDPD44qR8qemMh2OIyCPQYXtusCS3Bw Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Id: None Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Name: None Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Identity-Status: Confirmed Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Is-Admin-Project: True Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Id: default Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Name: Default Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Name: admin Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Role: reader,admin,member Jun 02 10:06:24.505292 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Roles: reader,admin,member Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant: admin Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Name: admin Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User: admin Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Id: default Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Name: Default Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Name: admin Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: method: > Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: exception: Flavor 84 could not be found. Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: action_args: {'id': '84'} Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:24.506863 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:24.508371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.509673 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-7fac3e86-9d83-497c-954f-944bf3592fc5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:24.510963 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-7fac3e86-9d83-497c-954f-944bf3592fc5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060401 Jun 02 10:06:24.510963 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 2 10:06:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:24.516873 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-524b066a-a720-44f0-9341-e2ec43175d75 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:24.531071 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-524b066a-a720-44f0-9341-e2ec43175d75 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017716 Jun 02 10:06:24.531644 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:06:24.540781 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-2128bec2-c073-43c7-ac94-0680f385203e admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:24.554306 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-2128bec2-c073-43c7-ac94-0680f385203e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017006 Jun 02 10:06:24.554827 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:06:24.563589 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c74f972f-725c-4592-9504-762fec9871f9 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:24.568773 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-c74f972f-725c-4592-9504-762fec9871f9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c74f972f-725c-4592-9504-762fec9871f9 admin admin] Request method failure captured: Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept: application/json Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Connection: keep-alive Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Content-Length: 0 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Host: 10.222.0.13 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABimIugzdc5sV7upDa9T1gme7bhLCwsleHJnNOP44d3duMX38WLZRHuPG_q3r9IBLQzgksWQghZ2sanIAAaikYSCCshmEewFPhQ250_UsvaFAtc-Si3K-gJAbqBcWrE5wsVEwLTXEa0E_8ZGTkfCDPD44qR8qemMh2OIyCPQYXtusCS3Bw Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Id: None Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Name: None Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Name: admin Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Role: reader,admin,member Jun 02 10:06:24.570765 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Roles: reader,admin,member Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant: admin Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User: admin Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Name: admin Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: method: > Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: exception: Flavor 84 could not be found. Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: action_args: {'id': '84'} Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:24.572296 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:24.573216 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:24.574480 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c74f972f-725c-4592-9504-762fec9871f9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:24.575905 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-c74f972f-725c-4592-9504-762fec9871f9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012012 Jun 02 10:06:24.575905 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 2 10:06:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 02 10:06:25.426725 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-2128bec2-c073-43c7-ac94-0680f385203e admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:25.427803 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-2128bec2-c073-43c7-ac94-0680f385203e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 02 10:06:25.428371 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:25.621393 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c6657f68-9951-4d71-a68b-cfd3fa862986 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:25.627261 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-c6657f68-9951-4d71-a68b-cfd3fa862986 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c6657f68-9951-4d71-a68b-cfd3fa862986 admin admin] Request method failure captured: Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept: application/json Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Connection: keep-alive Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Content-Length: 0 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Host: 10.222.0.13 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABimIuhDDzogx590jn00H619iz7kklQ4aXKVSlPe6zmfMPwbLeMd5dmk1oIQe0HzSq_px-jmPVcql29gu0OXoP1vz7eO3oDxVlCXb4IAdQthIaU4fhNuifGnU0ws-014D9VPmMmHeqRFMKfwzGsprOJgLq3exatJTCk6WaNITPaDGNZJ3s Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Id: None Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Domain-Name: None Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Project-Name: admin Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Role: reader,admin,member Jun 02 10:06:25.629030 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Roles: reader,admin,member Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant: admin Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User: admin Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: X-User-Name: admin Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: method: > Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: exception: Flavor 451 could not be found. Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: action_args: {'id': '451'} Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:25.630385 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:25.631222 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.632403 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-c6657f68-9951-4d71-a68b-cfd3fa862986 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:25.633444 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-c6657f68-9951-4d71-a68b-cfd3fa862986 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063892 Jun 02 10:06:25.633444 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:06:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:25.640198 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-7d7fb2ee-0f54-413a-a378-71fd70eb89e7 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:25.654344 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-7d7fb2ee-0f54-413a-a378-71fd70eb89e7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017705 Jun 02 10:06:25.654893 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:06:25.665040 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:25.678442 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017558 Jun 02 10:06:25.678958 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 2 10:06:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:06:25.688571 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-be85b209-908f-42f7-8046-e8331957ad2d admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:25.693918 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.wsgi [None req-be85b209-908f-42f7-8046-e8331957ad2d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-be85b209-908f-42f7-8046-e8331957ad2d admin admin] Request method failure captured: Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept: application/json Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Accept-Encoding: gzip, deflate Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Connection: keep-alive Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Content-Length: 0 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Host: 10.222.0.13 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-Api-Version: compute 2.90 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Openstack-System-Scope: None Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: User-Agent: python-novaclient Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Auth-Token: gAAAAABimIuhDDzogx590jn00H619iz7kklQ4aXKVSlPe6zmfMPwbLeMd5dmk1oIQe0HzSq_px-jmPVcql29gu0OXoP1vz7eO3oDxVlCXb4IAdQthIaU4fhNuifGnU0ws-014D9VPmMmHeqRFMKfwzGsprOJgLq3exatJTCk6WaNITPaDGNZJ3s Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Id: None Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Domain-Name: None Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Identity-Status: Confirmed Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Is-Admin-Project: True Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Openstack-Nova-Api-Version: 2.90 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Id: default Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Domain-Name: Default Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Project-Name: admin Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Role: reader,admin,member Jun 02 10:06:25.696134 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Roles: reader,admin,member Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a4fcfbbe473b47bea6be4001c8a8fd93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant: admin Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Id: a4fcfbbe473b47bea6be4001c8a8fd93 Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-Tenant-Name: admin Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User: admin Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Id: default Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Domain-Name: Default Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Id: 8ee8c41befe5418c95bad9a434d99f95 Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: X-User-Name: admin Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: method: > Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: exception: Flavor 451 could not be found. Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: action_args: {'id': '451'} Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:06:25.697476 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:25.698280 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: ERROR nova.api.openstack.wsgi Jun 02 10:06:25.699745 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-be85b209-908f-42f7-8046-e8331957ad2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103653) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:06:25.701016 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-be85b209-908f-42f7-8046-e8331957ad2d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012455 Jun 02 10:06:25.701016 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:06:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:26.552617 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:26.553619 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 02 10:06:26.554016 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:26.739209 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-f9c1da1f-d747-4feb-813c-0d6b2803c827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:06:26.812358 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-f9c1da1f-d747-4feb-813c-0d6b2803c827 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.124202 Jun 02 10:06:26.812905 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 2 10:06:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:06:27.672413 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:27.673428 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 02 10:06:27.673834 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:27.862098 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-4e7bb79b-3d37-4c88-8ca9-2c2d4506f285 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:06:27.915926 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-4e7bb79b-3d37-4c88-8ca9-2c2d4506f285 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.106091 Jun 02 10:06:27.916537 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 2 10:06:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:06:28.776942 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:28.777976 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 02 10:06:28.778379 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:28.966070 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-a6a30e62-8115-4d0a-a517-afc684003d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:06:29.018207 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-a6a30e62-8115-4d0a-a517-afc684003d66 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.102351 Jun 02 10:06:29.018810 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 2 10:06:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:06:29.877406 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:29.878411 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 02 10:06:29.878818 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:30.069164 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-9de4c524-eda2-4cec-b276-5ababc54faaa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:06:30.173943 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-9de4c524-eda2-4cec-b276-5ababc54faaa admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.156502 Jun 02 10:06:30.174416 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 2 10:06:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:06:31.038048 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:31.039137 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 02 10:06:31.039543 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:06:31.231165 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-af7624ed-a34b-42f9-9144-85770ff1b400 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:06:31.251020 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-af7624ed-a34b-42f9-9144-85770ff1b400 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071715 Jun 02 10:06:31.251594 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Thu Jun 2 10:06:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:07:32.539611 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.540916 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-51cd8b86-46c6-41e3-8afd-3f77bc80b437 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Jun 02 10:07:32.541323 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:07:32.548869 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:32.601667 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-cd9e925a-9198-4158-bed4-6e0c82707b70 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.622206 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-cd9e925a-9198-4158-bed4-6e0c82707b70 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074761 Jun 02 10:07:32.622755 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:07:32.643899 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=14 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:32.647628 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-6faeb411-c6fe-4ce3-990b-9903213607cb admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.655115 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-6faeb411-c6fe-4ce3-990b-9903213607cb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012692 Jun 02 10:07:32.655659 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:07:32.667538 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-33880d19-9197-4569-95b6-c0e00b1a68f6 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.675349 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-33880d19-9197-4569-95b6-c0e00b1a68f6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012009 Jun 02 10:07:32.675874 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:07:32.687437 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.695054 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011114 Jun 02 10:07:32.695630 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:07:32.706537 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-61b5bf41-6e10-49aa-b4f8-fdaac7070574 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:07:32.714009 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-61b5bf41-6e10-49aa-b4f8-fdaac7070574 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010947 Jun 02 10:07:32.714522 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 2 10:07:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:10:55.925139 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:10:55.926154 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 02 10:10:55.926559 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:10:56.083660 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_api:SELECT=6 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:10:56.197152 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:10:56.198310 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:10:56.198310 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:10:56.200180 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:10:56.200625 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:10:56.201407 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:10:56.201838 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:10:56.235355 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-cbc5aacd-1957-4940-95a2-7de5b8056a8d admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153280 Jun 02 10:10:56.235922 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:10:56 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:10:57.099619 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:10:57.100636 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 02 10:10:57.101267 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:10:57.291872 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:10:57.293663 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:10:57.293663 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:10:57.294849 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:10:57.295378 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:10:57.296170 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:10:57.296598 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:10:57.316506 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-85cbb9df-311b-41b3-aa2d-69b9dcf601d7 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075666 Jun 02 10:10:57.317055 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:10:57 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:11:08.605950 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:11:08.606958 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 02 10:11:08.607400 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:11:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:11:08.750471 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_cell0:SELECT=4 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:08.751273 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_cell1:SELECT=4 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:08.751878 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG dbcounter [-] [103653] Writing DB stats nova_api:SELECT=8 {{(pid=103653) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:08.800249 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:11:08.801404 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:11:08.801404 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:11:08.802636 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:11:08.803170 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:11:08.803899 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:11:08.806739 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:11:08.835397 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-33d5ab5e-88b3-4735-95c5-cedc482476ca admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083224 Jun 02 10:11:08.835397 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:11:08 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:11:09.699503 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:11:09.700513 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-704281d7-a95d-4f95-bfdb-bc4f7fc2cbe2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 02 10:11:09.700920 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 2 10:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:11:09.888921 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG nova.api.openstack.wsgi [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] Calling method '>' {{(pid=103653) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:11:09.890079 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:11:09.890079 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: warnings.warn(msg) Jun 02 10:11:09.891296 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:11:09.891765 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:11:09.892546 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:11:09.892971 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: DEBUG oslo_concurrency.lockutils [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103653) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:11:09.914718 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: INFO nova.api.openstack.requestlog [None req-18eac650-2f5e-4acd-9036-04e384e1a01a admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077594 Jun 02 10:11:09.915263 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: [pid: 103653|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 2 10:11:09 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:12:07.139160 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: Thu Jun 2 10:12:07 2022 - graceful shutdown triggered... Jun 02 10:12:07.139650 dv-cinder-797608-25-iscsi devstack@n-api.service[103654]: Gracefully killing worker 2 (pid: 103654)... Jun 02 10:12:07.140016 dv-cinder-797608-25-iscsi devstack@n-api.service[103653]: Gracefully killing worker 1 (pid: 103653)... Jun 02 10:12:07.141348 dv-cinder-797608-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 02 10:12:08.139968 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: worker 1 buried after 1 seconds Jun 02 10:12:08.139968 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: worker 2 buried after 1 seconds Jun 02 10:12:08.139968 dv-cinder-797608-25-iscsi devstack@n-api.service[103652]: goodbye to uWSGI. Jun 02 10:12:08.142247 dv-cinder-797608-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 02 10:12:08.142815 dv-cinder-797608-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 02 10:12:08.145831 dv-cinder-797608-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 02 10:12:08.163377 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 10:12:08 2022] *** Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: nodename: dv-cinder-797608-25-iscsi Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: machine: x86_64 Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: clock source: unix Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: pcre jit disabled Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: detected number of CPU cores: 4 Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: current working directory: / Jun 02 10:12:08.177062 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: detected binary path: /usr/bin/uwsgi-core Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: your processes number limit is 47680 Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: your memory page size is 4096 bytes Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: detected max file descriptor number: 2048 Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: lock engine: pthread robust mutexes Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: thunder lock: enabled Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 02 10:12:08.177894 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 10:12:08.224781 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: Python main interpreter initialized at 0x5593908d09c0 Jun 02 10:12:08.224781 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: python threads support enabled Jun 02 10:12:08.224781 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: your server socket listen backlog is limited to 100 connections Jun 02 10:12:08.224781 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: your mercy for graceful operations on workers is 90 seconds Jun 02 10:12:08.225278 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 10:12:08.225370 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: *** Operational MODE: preforking *** Jun 02 10:12:08.225657 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: *** uWSGI is running in multiple interpreter mode *** Jun 02 10:12:08.225657 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: spawned uWSGI master process (pid: 118050) Jun 02 10:12:08.225863 dv-cinder-797608-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 02 10:12:08.226428 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: spawned uWSGI worker 1 (pid: 118066, cores: 1) Jun 02 10:12:08.230018 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: spawned uWSGI worker 2 (pid: 118067, cores: 1) Jun 02 10:12:08.230018 dv-cinder-797608-25-iscsi devstack@n-api.service[118050]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 10:12:09.476983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 10:12:09.477579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 02 10:12:10.310841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:12:10.310841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: from cryptography.utils import int_from_bytes Jun 02 10:12:10.311194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:12:10.311194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: from cryptography.utils import int_from_bytes Jun 02 10:12:10.312470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:12:10.312470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: from cryptography.utils import int_from_bytes Jun 02 10:12:10.312810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 10:12:10.312810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: from cryptography.utils import int_from_bytes Jun 02 10:12:12.686977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 10:12:12.687665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 10:12:12.687772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 10:12:12.688132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 10:12:12.688390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 10:12:12.688781 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.689109 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.689432 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.689755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.690088 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.690423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.690736 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.691056 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.691192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 10:12:12.691575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 10:12:12.691686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.691686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.691870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 10:12:12.691962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.692233 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 10:12:12.692335 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-25-iscsi {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.692495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 10:12:12.692596 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.692885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.692982 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.693926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694781 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.694957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.695146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.695412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.695518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.695714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.695809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-25-iscsi {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.696982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697085 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.697929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.698055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.698278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.698379 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.698683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-25-iscsi {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.699431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.699581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.699787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.699891 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.700937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701074 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.701899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702357 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702688 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.702867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703005 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-25-iscsi {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703534 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.703861 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704561 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.704886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705593 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.705902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.706855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707369 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707696 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.707807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708021 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708755 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.708955 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709266 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709672 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.709933 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710258 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.710956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711195 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711623 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.711949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.712909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713009 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713539 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713852 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.713952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714165 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714873 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.714975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715868 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.715970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716281 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716763 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.716907 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717169 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.717808 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718628 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.718932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.719032 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.719263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.719572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.719664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.719883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.720153 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.720253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.720489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.720745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.720837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.721970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.722970 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723326 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723839 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.723945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724453 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.724878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725470 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725788 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.725992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.726919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727030 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727366 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727677 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.727989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728178 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728570 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.728903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729100 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.729825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.730980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731167 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.731937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.732181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.732347 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.732498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.732656 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.733671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.733836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.733983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.734137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.734287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.734453 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.734598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.734746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.734902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.735044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.735212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.735386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.735538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.735744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.735899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.736048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.736204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.736346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.736498 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.736668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.736834 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.736982 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.737142 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.737297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.737444 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.737595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.737747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.737894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.738052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.738197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.738350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.738514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.738668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.738821 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.738982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.739155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 10:12:12.739309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.739455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.739611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.739767 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.739915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740511 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.740972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741432 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741736 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.741889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.742931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743425 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743725 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.743870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744620 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744771 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.744924 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.745070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.745215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.745376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.745522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.746240 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.746401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.746817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.746964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747468 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747618 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.747907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748193 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748505 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748651 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.748951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749418 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749730 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.749884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750036 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750332 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750486 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750796 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.750941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751431 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751590 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.751895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.752898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753521 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.753987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754602 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754755 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.754900 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755426 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.755886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756040 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756664 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.756971 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757450 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.757904 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758797 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.758961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759638 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.759951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760592 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.760893 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.761046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.761199 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.761986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.762135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.762291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.762454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.762621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.762841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763510 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.763958 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.764132 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.764497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.764662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.764809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.764809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765101 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.765853 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766174 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.766866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.767981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.768136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.768569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.768719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.768865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769165 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.769895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.770975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771460 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.771919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.772857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773707 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.773862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774169 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.774929 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775267 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.775889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776041 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.776884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777041 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777488 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.777929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778074 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778693 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.778847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779633 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.779923 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780081 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780388 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.780986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.781130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.781275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.781419 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.781579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.781915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.782991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.783258 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.783411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.783557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.783701 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.783864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784020 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784165 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.784930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.785995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.786148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.786301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.786526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.786683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.786836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787553 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.787851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788484 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.788951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789110 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.789909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790692 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.790862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.791859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792020 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792180 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.792919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.793089 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.793269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.793505 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.793670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.793823 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794012 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.794974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795333 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795800 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.795951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796425 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.796891 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797069 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797457 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797457 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.797909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.798852 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.799874 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800040 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800353 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.800989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801316 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801470 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.801935 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802400 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.802884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803047 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803427 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.803997 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804150 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.804980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805065 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805803 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.805978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806074 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806256 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.806917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807002 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807321 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.807976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.808560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.808660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.808755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.808848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.808933 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809100 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809189 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809381 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809577 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.809914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810841 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.810995 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811154 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811448 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.811962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.812969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813131 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813448 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.813878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.814192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.814417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.814575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.814739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.814901 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815457 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815782 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.815935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816421 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.816903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817056 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.817944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818103 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818593 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.818908 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819246 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.819928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.820970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821437 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821599 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821761 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.821915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822727 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.822895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.823055 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.823249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.823404 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.823556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.823708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.824599 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.824768 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.824938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825592 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825751 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.825916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826391 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.826867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827204 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827778 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.827941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828094 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.828883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829045 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829207 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829522 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829684 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.829997 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.830202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.830373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.830528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.830694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.830847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831329 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.831912 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832004 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832101 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832197 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.832917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833300 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833300 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833557 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833832 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.833917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834094 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.834988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835559 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.835980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836526 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.836945 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837176 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837819 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.837939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838451 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838768 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.838873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839085 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839555 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.839883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.840088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.840404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.840514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.840719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.840833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841032 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841673 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.841980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842600 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.842917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.843052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.843250 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.843392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.843687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.843804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844008 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.844964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845256 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.845895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.846961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.847946 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848258 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848689 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.848904 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849215 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.849936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850142 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850457 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850592 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.850949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851862 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.851967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.852287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.852390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.852605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.852702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.852939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853403 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.853891 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.854841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855004 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855277 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.855924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856240 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.856862 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.857799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.858771 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.859792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860106 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.860938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861270 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861581 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861677 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.861900 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862215 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.862963 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.863200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.863371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.863511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.863706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.863803 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864032 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864468 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864684 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.864782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865169 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.865999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866094 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866312 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866618 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.866927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.867979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868205 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.868952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869266 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.869879 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.870092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.870195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.870438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.870548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.871377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.871760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.871955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.872890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873566 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.873968 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874245 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.874876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875064 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875546 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.875874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.876984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.877998 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.878215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.878350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.878538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.878679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.878859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879002 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.879973 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880155 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.880940 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881602 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.881913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882234 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.882885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883129 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883450 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.883935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884094 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884726 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.884904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885047 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.885873 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.886017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.886201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.886856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887601 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.887921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888056 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888400 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888738 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.888920 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.889909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890058 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890684 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.890864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891347 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891852 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.891986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.892948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893266 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893590 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.893952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.894844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895693 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.895826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896329 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896673 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.896855 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.897968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898820 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.898953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899300 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899609 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.899924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900094 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900552 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.900859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.901978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.902113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.902289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.902519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.902654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.902867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.903998 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.904911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905696 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.905831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906012 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906467 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906615 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.906926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907547 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.907994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908166 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.908948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909435 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.909888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.910972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.911119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.911318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.911452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.911631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.911902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912052 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912555 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.912866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913012 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913316 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913521 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.913982 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914742 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.914862 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.915846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916019 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.916956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.917212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.917340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.917578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.917708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.917912 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.918263 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.918501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.918636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.918834 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.918969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919849 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.919983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920165 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920627 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.920934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921117 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.921881 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.922989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923645 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.923959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924590 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.924917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925243 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.925888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926032 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926656 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.926968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.927183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.927319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.927531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.927666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.927866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928189 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928815 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.928957 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929818 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.929953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930268 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930441 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.930889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.931902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932165 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.932914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.933612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.933765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.933916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934538 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934672 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.934946 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.935987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936615 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.936924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.937878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938196 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938656 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.938980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939804 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.939944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940114 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.940876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941179 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941495 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.941974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942116 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942435 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942771 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.942948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943283 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943418 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.943927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944598 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.944879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945324 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945499 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.945947 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.946883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947723 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.947857 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.948051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.948191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.948363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.948502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.948704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.949361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.949567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.949712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.949898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950033 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950356 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950692 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.950882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.951986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.952113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 10:12:12.952243 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.952473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.952798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.953122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.953456 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.953790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.954108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.954442 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.954781 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.955156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.955479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.955833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.956169 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.956493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.956811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.957124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 10:12:12.957374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 10:12:13.012589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO dbcounter [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Registered counter for database nova_api Jun 02 10:12:13.017817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO dbcounter [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Registered counter for database nova_api Jun 02 10:12:13.033060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_db.sqlalchemy.engines [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.037805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_db.sqlalchemy.engines [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.039980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writer thread running {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.044833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writer thread running {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.098429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.context [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb173f29-3e1b-4df6-96a9-19c3d8f141fb(cell1) {{(pid=118066) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 10:12:13.102451 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.context [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bb173f29-3e1b-4df6-96a9-19c3d8f141fb(cell1) {{(pid=118067) load_cells /opt/stack/nova/nova/context.py:464}} Jun 02 10:12:13.102619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:12:13.104261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:12:13.105583 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:12:13.107296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:12:13.113167 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:12:13.113293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:12:13.113388 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO dbcounter [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Registered counter for database nova_cell0 Jun 02 10:12:13.113477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:12:13.113477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:12:13.113748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO dbcounter [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Registered counter for database nova_cell0 Jun 02 10:12:13.113860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO dbcounter [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Registered counter for database nova_cell1 Jun 02 10:12:13.117762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO dbcounter [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Registered counter for database nova_cell1 Jun 02 10:12:13.123017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_db.sqlalchemy.engines [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.123739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_db.sqlalchemy.engines [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.125714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_db.sqlalchemy.engines [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.127778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_db.sqlalchemy.engines [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.131041 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writer thread running {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.132387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writer thread running {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.135157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writer thread running {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.135403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writer thread running {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.282110 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO dbcounter [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Registered counter for database nova_cell0 Jun 02 10:12:13.289579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_db.sqlalchemy.engines [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.291080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO dbcounter [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Registered counter for database nova_cell0 Jun 02 10:12:13.295073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writer thread running {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.298541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_db.sqlalchemy.engines [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 10:12:13.303439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writer thread running {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 10:12:13.734410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: WARNING keystonemiddleware.auth_token [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:12:13.742720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: WARNING keystonemiddleware.auth_token [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:12:13.750792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: WARNING keystonemiddleware.auth_token [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:12:13.758094 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: WARNING keystonemiddleware.auth_token [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:12:13.969105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: WARNING keystonemiddleware.auth_token [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:12:13.975142 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: WARNING keystonemiddleware.auth_token [None req-2a63550b-4591-4830-9dae-61e258fe9977 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:12:13.979693 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: WARNING keystonemiddleware.auth_token [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 02 10:12:13.980287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593908d09c0 pid: 118066 (default app) Jun 02 10:12:13.985782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: WARNING keystonemiddleware.auth_token [None req-064d2710-ce8d-4305-88ec-e950b1a9146c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 02 10:12:13.990974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5593908d09c0 pid: 118067 (default app) Jun 02 10:12:55.459777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.459777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.459777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.460749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:57.030859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e61867ca-4281-43dc-a78a-420ff675cc37 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Action: 'create', calling method: .version_select at 0x7f49dfd6a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-983160453", "metadata": {"Type": "work"}}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:12:58.506493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.512498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.513531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.519077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.980106 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-955503312", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "networks": [{"uuid": "ff75b8fd-feaf-4e7d-9620-4bc13449e3a5"}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:12:59.273214 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e61867ca-4281-43dc-a78a-420ff675cc37 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.818300 Jun 02 10:12:59.273214 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 2 10:12:55 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3821 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 10:12:59.286682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-55fa25be-7c5d-46a2-ac65-9cc088a84cd3 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49dfc32310>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:12:59.383325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] validate_networks() for [('ff75b8fd-feaf-4e7d-9620-4bc13449e3a5', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:12:59.436318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-55fa25be-7c5d-46a2-ac65-9cc088a84cd3 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 200 len: 352 microversion: 2.1 time: 0.154363 Jun 02 10:12:59.437378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:12:59 2022] GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:00.308647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-abf67c43-3f5c-4e7d-925d-b0d99ee86b84 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49dfc324c0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:00.393747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-abf67c43-3f5c-4e7d-925d-b0d99ee86b84 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8eb7c336-fbb8-4932-bb75-5df3097d678a" status: 200 len: 351 microversion: 2.1 time: 0.088954 Jun 02 10:13:00.394322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 3/3] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:00 2022] GET /compute/v2.1/os-volumes/8eb7c336-fbb8-4932-bb75-5df3097d678a => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:13:00.453707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7ed3e904-42d2-4fa4-977e-7d053d74be4a tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49dfc32af0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:00.739302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7ed3e904-42d2-4fa4-977e-7d053d74be4a tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 200 len: 353 microversion: 2.1 time: 0.292062 Jun 02 10:13:00.739302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 4/4] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:00 2022] GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 353 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:13:00.750944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aad98600-0b42-4dbe-89c9-dc2b2a90be22 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49dfbc81f0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:00.758439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:13:00.759356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:13:00.760818 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:13:00.761811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:13:00.762245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:13:00.791748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:00.792532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:00.793784 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:00.794389 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:00.838903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Getting quotas for project 0025aa9f920f45729d8516c9e315e448. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:13:00.849731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Getting quotas for user aea254e4bdc142b9ae1767335fd84d61 and project 0025aa9f920f45729d8516c9e315e448. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:13:00.866970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:13:00.869889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:13:01.019585 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d4e3d363-da2d-4255-80ce-b49fc28a1563 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530984 Jun 02 10:13:01.021067 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 1/5] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 10:13:01.036583 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-789ed599-88cf-4f3a-b44c-0da4105692a6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:01.036824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-789ed599-88cf-4f3a-b44c-0da4105692a6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:01.367653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-789ed599-88cf-4f3a-b44c-0da4105692a6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:01.381490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-aad98600-0b42-4dbe-89c9-dc2b2a90be22 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 200 len: 353 microversion: 2.1 time: 0.633874 Jun 02 10:13:01.382386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 5/6] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:00 2022] GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 353 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:01.396187 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-789ed599-88cf-4f3a-b44c-0da4105692a6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1214 microversion: 2.1 time: 0.364512 Jun 02 10:13:01.399845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fc5d30f9-eb41-4e8d-9042-447d8d957b4b tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49dfc32c10>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:01.403223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 2/7] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:01 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:01.968755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fc5d30f9-eb41-4e8d-9042-447d8d957b4b tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 202 len: 0 microversion: 2.1 time: 0.572167 Jun 02 10:13:01.968755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 6/8] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:13:01 2022] DELETE /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:13:01.977251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7cff6d1f-ee4d-4e35-851b-f36edfe0e39e tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49deb048b0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:02.190399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7cff6d1f-ee4d-4e35-851b-f36edfe0e39e tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 200 len: 352 microversion: 2.1 time: 0.217995 Jun 02 10:13:02.190961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 3/9] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:01 2022] GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:02.426291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-80f945a8-3c0d-4c88-95d6-bb082a5742c0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:02.427064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-80f945a8-3c0d-4c88-95d6-bb082a5742c0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:02.661358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d405bae7-2566-43e4-8299-ca915b41c045 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49deae7e50>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:02.681546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-80f945a8-3c0d-4c88-95d6-bb082a5742c0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:02.758909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-80f945a8-3c0d-4c88-95d6-bb082a5742c0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1214 microversion: 2.1 time: 0.335643 Jun 02 10:13:02.769053 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 7/10] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:02 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1214 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:02.821226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d405bae7-2566-43e4-8299-ca915b41c045 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f5f47b8d-2102-48d2-bf01-0709681189c1" status: 200 len: 351 microversion: 2.1 time: 0.163730 Jun 02 10:13:02.821908 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 4/11] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:02 2022] GET /compute/v2.1/os-volumes/f5f47b8d-2102-48d2-bf01-0709681189c1 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:13:03.204031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7a491683-6a2b-4e43-a0f0-832e5e350d78 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Calling method '.version_select at 0x7f49dfbc8a60>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:03.362657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-7a491683-6a2b-4e43-a0f0-832e5e350d78 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] HTTP exception thrown: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7a491683-6a2b-4e43-a0f0-832e5e350d78 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Request method failure captured: Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 HTTP/1.1 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI0nnxO-R0qKi4nsVrvKW1m_f_OdooXS0ISDcOC-BsarKkVMLANuIAoFe8P0dA8n46vzIaqUeJ-UKTFIn09DCL66nejXhgP3PbFxnqYSqHunnH1D6aXHs2JdDyYq90124YQ1QdihhZescadqpB2xpZmBTUNWY9TI4MWzf8xKQFFKnok Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 6beed4978c174ffe81c6ee8ea79ae7f3 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesGetTestJSON-1097165625 Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:13:03.376243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6beed4978c174ffe81c6ee8ea79ae7f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_6beed4978c174ffe81c6ee8ea79ae7f3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/6beed4978c174ffe81c6ee8ea79ae7f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/6beed4978c174ffe81c6ee8ea79ae7f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesGetTestJSON-1097165625 Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 6beed4978c174ffe81c6ee8ea79ae7f3 Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesGetTestJSON-1097165625 Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesGetTestJSON-1097165625-project Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 20cbad694976400f94f2d0e6a63cdb98 Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesGetTestJSON-1097165625-project Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'd2db32d1-c560-4403-b949-1402ab4cd846'} Jun 02 10:13:03.377461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. (HTTP 404) (Request-ID: req-617d465b-22db-44a2-8a29-7c3971a1e3a3) Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:13:03.378217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:13:03.379393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 10:13:03.380489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. Jun 02 10:13:03.381584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:13:03.382473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7a491683-6a2b-4e43-a0f0-832e5e350d78 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] Returning 404 to user: Volume d2db32d1-c560-4403-b949-1402ab4cd846 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:13:03.386854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7a491683-6a2b-4e43-a0f0-832e5e350d78 tempest-VolumesGetTestJSON-1097165625 tempest-VolumesGetTestJSON-1097165625-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846" status: 404 len: 109 microversion: 2.1 time: 0.186045 Jun 02 10:13:03.389889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 8/12] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:03 2022] GET /compute/v2.1/os-volumes/d2db32d1-c560-4403-b949-1402ab4cd846 => generated 109 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:13:03.783307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ba638d37-e9a8-44d2-a7e0-1c0633e3307a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:03.784541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ba638d37-e9a8-44d2-a7e0-1c0633e3307a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:04.302185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ba638d37-e9a8-44d2-a7e0-1c0633e3307a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:04.357310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ba638d37-e9a8-44d2-a7e0-1c0633e3307a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1214 microversion: 2.1 time: 0.571841 Jun 02 10:13:04.359368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 5/13] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:03 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1214 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:05.375332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:05.375942 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:05.405565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:05.408340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:05.418000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:05.418638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:05.679450 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:05.693465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-47f3dcc1-4d95-4b20-bcdb-50caaf1375e1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1210 microversion: 2.1 time: 0.323267 Jun 02 10:13:05.704282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 9/14] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:05 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1210 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:06.720517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:06.721289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:06.731836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:06.732498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:06.733435 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:06.734210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:07.070397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:07.096383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-baa09bdb-8d89-4559-a98e-ca29b7c8dbfa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1210 microversion: 2.1 time: 0.377859 Jun 02 10:13:07.097776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 6/15] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:06 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1210 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:07.237259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-357088767", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:07.505586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] validate_networks() for [('17d5c6d4-5995-4814-a0c3-133509337a04', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:13:08.118776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:08.119534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:08.130284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:08.132115 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:08.135137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:08.135801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:08.330296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:08.363161 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-94b33604-a8bd-4e1e-8218-9613a96e3285 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1266 microversion: 2.1 time: 0.250047 Jun 02 10:13:08.379950 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 7/16] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:08 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:09.250898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c5f8765d-f7e3-46a3-949b-c72400c71c49 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: .version_select at 0x7f49dea12160>, body: {"keypair": {"name": "tempest-keypair-96939200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtKjdeCC3vuYnH/emVTQND2Ns0KS6CUEwlUtw4JJtM8+EnUlFxy2VVsXXVLGSCwEwF/Z36gRsaUL5LfaakAEKFgD6WaijLSf3gCwr6WXrB8FaRZe2yo4zLjQ/n7sW7qnA=="}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:09.296391 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:13:09.297766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:13:09.298428 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:13:09.298988 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:13:09.299777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:13:09.319410 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-c5f8765d-f7e3-46a3-949b-c72400c71c49 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:13:09.330008 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-c5f8765d-f7e3-46a3-949b-c72400c71c49 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:13:09.336887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:09.338433 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:09.340795 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:09.343847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:09.438728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:13:09.463773 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for user a696d00855ef439c9d80b6bec5312f20 and project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:13:09.499983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:13:09.513905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:13:09.526432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c5f8765d-f7e3-46a3-949b-c72400c71c49 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.725521 Jun 02 10:13:09.527337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 8/17] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:13:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:09.532261 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:09.533024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:09.564401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:09.564858 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:09.578236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:09.580035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:09.754125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:09.774024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d563262f-b581-416d-ada5-e695c99499cf tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1266 microversion: 2.1 time: 0.245438 Jun 02 10:13:09.778613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-41b8497b-5b37-4ff5-9776-610a0b94aeed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.760995 Jun 02 10:13:09.785256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 10/18] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:13:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:13:09.787055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:09 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:09.797244 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ec303ffc-70f5-4929-b856-5d38eeb9770a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:09.799140 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ec303ffc-70f5-4929-b856-5d38eeb9770a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:10.412715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ec303ffc-70f5-4929-b856-5d38eeb9770a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:10.423229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ec303ffc-70f5-4929-b856-5d38eeb9770a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1221 microversion: 2.1 time: 0.636184 Jun 02 10:13:10.437239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 11/20] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:09 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1221 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:10.678589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-190032367", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:10.764134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ec9e7a5d-5b78-4e27-beba-92176fb6c428 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49dfa02d30>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:10.826543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] validate_networks() for [('17d5c6d4-5995-4814-a0c3-133509337a04', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:13:10.833613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:10.930642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ec9e7a5d-5b78-4e27-beba-92176fb6c428 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/bdf07403-9f01-489f-8e61-c2632b4411e0" status: 200 len: 351 microversion: 2.1 time: 0.173454 Jun 02 10:13:10.939406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 12/21] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:13:10 2022] GET /compute/v2.1/os-volumes/bdf07403-9f01-489f-8e61-c2632b4411e0 => generated 351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:10.945923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:10.946929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:10.977985 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:10.981952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:10.984352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:10.988638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:11.153490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:11.168888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ad4db24b-69df-4a55-99ed-8be4221a2880 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1272 microversion: 2.1 time: 0.221393 Jun 02 10:13:11.174280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 13/22] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:10 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:11.192845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-abe436ed-490b-4f8d-a8d0-cccf64be7277 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49df1ad280>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:11.415885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-abe436ed-490b-4f8d-a8d0-cccf64be7277 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.239300 Jun 02 10:13:11.416500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 14/23] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 2 10:13:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:11.431321 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5ebe794d-0bb5-46f3-ab2a-1ae045ffe822 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49df1ba5e0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:11.853532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5ebe794d-0bb5-46f3-ab2a-1ae045ffe822 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.425993 Jun 02 10:13:11.861833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 15/24] 10.222.0.13 () {58 vars in 1148 bytes} [Thu Jun 2 10:13:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:11.867087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5d3c2496-6766-40fa-8df5-b5b152d3c9ad tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49df1ad9d0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:11.987629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:13:11.988209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:13:11.988668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:13:11.989286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:13:11.989884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:13:12.015477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:12.024428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:12.028486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:12.040777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:12.100606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:13:12.110328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for user a696d00855ef439c9d80b6bec5312f20 and project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:13:12.144126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:13:12.148522 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:13:12.428157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3b025c64-8fe9-4d76-9822-29a3b7a0ff60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.763291 Jun 02 10:13:12.431667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 10/25] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:13:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:13:12.441822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:12.452178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:12.468299 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:12.469661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:12.471286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:12.472686 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:12.587345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:12.595595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-63700575-cbc7-478a-b183-bd10cbe16ed1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1272 microversion: 2.1 time: 0.161567 Jun 02 10:13:12.605507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 11/26] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:12 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:12.605507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6b2bf5ab-f16a-45db-836a-5b38b4e99a3f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:12.605507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6b2bf5ab-f16a-45db-836a-5b38b4e99a3f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:12.743720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6b2bf5ab-f16a-45db-836a-5b38b4e99a3f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:12.759687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6b2bf5ab-f16a-45db-836a-5b38b4e99a3f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1221 microversion: 2.1 time: 0.158164 Jun 02 10:13:12.771135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:12 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:12.886587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5d3c2496-6766-40fa-8df5-b5b152d3c9ad tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 1.023151 Jun 02 10:13:12.906987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 2 10:13:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:12.912080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1ec9c91a-4ba0-4c3c-a1ae-28092c77ce5f tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49de9f1160>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:13.273304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1ec9c91a-4ba0-4c3c-a1ae-28092c77ce5f tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.376404 Jun 02 10:13:13.292618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 13/29] 10.222.0.13 () {58 vars in 1166 bytes} [Thu Jun 2 10:13:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:13.297749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2c199f74-0a70-42fb-bac3-9661868dc0bc tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49dfa02790>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:13.638307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:13.638307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:13.638307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:13.638307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:13.640419 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:13.640419 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:14.051987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2c199f74-0a70-42fb-bac3-9661868dc0bc tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.769131 Jun 02 10:13:14.060241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 17/30] 10.222.0.13 () {58 vars in 1169 bytes} [Thu Jun 2 10:13:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:14.065571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-492c1c18-848f-48bd-8c78-95ef926c5c25 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:14.066491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-492c1c18-848f-48bd-8c78-95ef926c5c25 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:14.215071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-492c1c18-848f-48bd-8c78-95ef926c5c25 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:14.234915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-492c1c18-848f-48bd-8c78-95ef926c5c25 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1221 microversion: 2.1 time: 0.173354 Jun 02 10:13:14.240568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 18/31] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:14 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1221 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:14.249729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:14.259879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a07bc0f7-6e96-4ea8-8e13-10cb15ecc31d tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49df1bab80>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:14.271459 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2e44bcaa-8b13-487c-9c54-d3050f6f9c64 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.657227 Jun 02 10:13:14.272589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 14/32] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:13 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:14.683438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a07bc0f7-6e96-4ea8-8e13-10cb15ecc31d tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.440605 Jun 02 10:13:14.684798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 19/33] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 2 10:13:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:14.696122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ce30de8d-881f-4ccf-b294-cee35b6eec95 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49de9c7dc0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:14.836358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ce30de8d-881f-4ccf-b294-cee35b6eec95 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.144026 Jun 02 10:13:14.837369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 15/34] 10.222.0.13 () {58 vars in 1187 bytes} [Thu Jun 2 10:13:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:14.850141 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-28717a40-388d-402c-8a65-f76cab565254 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] Calling method '.version_select at 0x7f49df1ade50>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:14.989914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-28717a40-388d-402c-8a65-f76cab565254 tempest-VolumesTestJSON-527027156 tempest-VolumesTestJSON-527027156-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.145052 Jun 02 10:13:14.990834 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 20/35] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 2 10:13:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:15.258304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:15.259224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:15.289558 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:15.291035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:15.308045 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:15.309625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:15.311674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:15.313527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:15.314213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:15.315023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:15.319775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:15.320465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:15.455077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:15.468500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3047e5f7-4a8d-4368-abf4-7269d667c642 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1217 microversion: 2.1 time: 0.210580 Jun 02 10:13:15.479356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 16/36] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:15 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:16.332641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:16.347025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7c35cfb2-2b15-46c5-8474-04499e720b7c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 1.062111 Jun 02 10:13:16.352500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 21/37] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:15 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:16.476765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1641635473", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63a76883-1c17-4c5d-93bd-cf38b26e86c2"}], "security_groups": [{"name": "tempest-securitygroup--389668502"}], "key_name": "tempest-keypair-96939200", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:16.488799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-5206b058-f4ac-47b2-b813-3b7f67670cbc req-a18d347f-9aed-4767-8a2e-02a2ebd145a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc80296-c07d-44ee-af27-e0b80e3a3b4b", "tag": "2fc033ee-39b2-473c-8a55-ebe57d07c7c3"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:16.502108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-5206b058-f4ac-47b2-b813-3b7f67670cbc req-a18d347f-9aed-4767-8a2e-02a2ebd145a2 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:16.502753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-5206b058-f4ac-47b2-b813-3b7f67670cbc req-a18d347f-9aed-4767-8a2e-02a2ebd145a2 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:16.540346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-5206b058-f4ac-47b2-b813-3b7f67670cbc req-a18d347f-9aed-4767-8a2e-02a2ebd145a2 service nova] Creating event network-changed:2fc033ee-39b2-473c-8a55-ebe57d07c7c3 for instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b on hv-cinder-79760 Jun 02 10:13:16.546723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-5206b058-f4ac-47b2-b813-3b7f67670cbc req-a18d347f-9aed-4767-8a2e-02a2ebd145a2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 10:13:16.546723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:16.546723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:16.546723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:16.546723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:16.553204 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.compute.rpcapi [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 10:13:16.554112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] Releasing lock "compute-rpcapi-router" {{(pid=118067) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 10:13:16.585091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-36a64551-2716-42d7-bdbb-03e8ed6c4467 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173999 Jun 02 10:13:16.586053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 17/38] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:16.591813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:16.592480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:16.599347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:16.599970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:16.600905 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:16.601410 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:16.744534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:16.754586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-67b4087e-104a-4bb4-8093-670fc5447be3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1273 microversion: 2.1 time: 0.166870 Jun 02 10:13:16.755281 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 18/39] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:16 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1273 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:16.949139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] validate_networks() for [('63a76883-1c17-4c5d-93bd-cf38b26e86c2', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:13:17.374364 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:17.383171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:17.402078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:17.404910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:17.409429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:17.410443 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:17.732311 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:17.754959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-676004fc-28aa-4e66-8e30-1186a45f7a85 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.390074 Jun 02 10:13:17.755788 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 19/40] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:17 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:17.772994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:17.774084 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:17.793709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:17.794490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:17.796378 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:17.796831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:17.882996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:17.896629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d31b178a-7f08-4d71-a3de-9fa31624959b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1291 microversion: 2.1 time: 0.128472 Jun 02 10:13:17.897407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 20/41] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:17 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1291 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:18.532571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:13:18.536613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:13:18.536613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:13:18.536613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:13:18.536613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:13:18.564670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:18.565147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:18.568211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:18.568211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:18.630598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:13:18.640438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:13:18.658758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:13:18.681442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:13:18.777845 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:18.780154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:18.796448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:18.799284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:18.801765 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:18.803714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:18.845279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-20b51820-b96c-4d90-99aa-ab3a86944ea9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.374928 Jun 02 10:13:18.846013 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:13:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 10:13:18.868491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3da50555-8475-49ca-b8eb-92470db9e1ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:18.869861 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3da50555-8475-49ca-b8eb-92470db9e1ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:19.215711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3da50555-8475-49ca-b8eb-92470db9e1ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:19.238383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3da50555-8475-49ca-b8eb-92470db9e1ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1240 microversion: 2.1 time: 0.385989 Jun 02 10:13:19.239422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 23/43] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:18 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1240 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:19.263388 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:19.264050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:19.284932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:19.285397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:19.286171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:19.295952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:19.463359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:19.475112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1688527a-417b-49c8-90ec-1f42b27dda5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1279 microversion: 2.1 time: 0.234521 Jun 02 10:13:19.490802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 24/44] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:19 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:19.715691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:19.726683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-de0dd091-561e-4e33-82ce-5e245874a077 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.955901 Jun 02 10:13:19.747239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 21/45] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:18 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:20.278588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ece30c46-090e-40f8-a0dc-7250d1f35240 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:20.283702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ece30c46-090e-40f8-a0dc-7250d1f35240 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:20.495719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:20.497409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:20.508705 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:20.512428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:20.514167 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:20.514796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:20.571380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ece30c46-090e-40f8-a0dc-7250d1f35240 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:20.584374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ece30c46-090e-40f8-a0dc-7250d1f35240 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1240 microversion: 2.1 time: 0.327803 Jun 02 10:13:20.597738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 25/46] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:20 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1240 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:20.743408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:20.744221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:20.759487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:20.760054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:20.761352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:20.761814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:20.847927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:20.864434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a3947ea4-37ff-4d73-b2fb-028012b14db9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1279 microversion: 2.1 time: 0.374212 Jun 02 10:13:20.875860 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:20 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:21.000846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:21.008913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0ad68db2-8878-485c-85bb-2b43a2ec1f25 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.269500 Jun 02 10:13:21.009565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 26/48] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:20 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:21.606348 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:21.607884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:21.614790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:21.615278 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:21.616051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:21.616487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:21.720123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:21.728333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-225de221-8885-416e-b13e-247b7765bdc8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.126817 Jun 02 10:13:21.728910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 23/49] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:21 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:21.884345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:21.885913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:21.892712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:21.893417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:21.894496 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:21.894931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.028667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:22.029743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:22.037099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:22.037875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.038685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:22.039232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.180716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:22.188429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:22.188761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3d860555-1650-4216-b8df-68bebaa4d057 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.166768 Jun 02 10:13:22.197984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 24/50] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:22 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:22.207376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3ebf8791-7c97-4d20-a6b6-c0c4be07df7d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.329092 Jun 02 10:13:22.208352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 27/51] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:21 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:22.264689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-ec8aea7e-9cb9-40f6-a77d-cbbfd5ad7455 req-44be5bc9-516a-45a0-b6ab-1c391df5a731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd186230-f6d5-41ad-abf4-ff9671465a29", "tag": "dc2364a5-75e4-4d94-9213-794f385c71db"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:22.278569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-ec8aea7e-9cb9-40f6-a77d-cbbfd5ad7455 req-44be5bc9-516a-45a0-b6ab-1c391df5a731 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:22.287228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-ec8aea7e-9cb9-40f6-a77d-cbbfd5ad7455 req-44be5bc9-516a-45a0-b6ab-1c391df5a731 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.308669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-ec8aea7e-9cb9-40f6-a77d-cbbfd5ad7455 req-44be5bc9-516a-45a0-b6ab-1c391df5a731 service nova] Creating event network-changed:dc2364a5-75e4-4d94-9213-794f385c71db for instance cd186230-f6d5-41ad-abf4-ff9671465a29 on hv-cinder-79760 Jun 02 10:13:22.315239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-ec8aea7e-9cb9-40f6-a77d-cbbfd5ad7455 req-44be5bc9-516a-45a0-b6ab-1c391df5a731 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054112 Jun 02 10:13:22.316153 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 25/52] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:22.746487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:22.747120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:22.754805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:22.755297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.756086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:22.756530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:22.829243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:22.837827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-eec8676b-d2f8-42da-9296-6c9f7729047e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.095550 Jun 02 10:13:22.839998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:22 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:23.202826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=22 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:23.206967 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:23.207730 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:23.213953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.214409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.215216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.215660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.226816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:23.228433 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:23.236112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.237172 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.238576 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.239310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.362631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:23.371393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e6fe4efb-20ea-4677-9eb5-a626246341e8 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.169125 Jun 02 10:13:23.372523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:23 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:23.374613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:23.384396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1607a9f8-86f7-48c4-a2d5-4809452d67b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.163321 Jun 02 10:13:23.384965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 29/55] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:23 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:23.860491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:23.861247 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:23.868171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.868625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.869395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:23.869938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:23.936867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:23.940408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:23.944756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4e358265-4002-42ec-922c-46bf92c54ebc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.093251 Jun 02 10:13:23.954121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 27/56] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:23 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:24.390238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:24.390973 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:24.397043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.397499 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:24.398298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.398742 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:24.402411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:24.404498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:24.409423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.409978 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:24.410848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.411416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:24.551045 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:24.559341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-53203606-581a-4ab4-b81c-406b9c91b0bd tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.173414 Jun 02 10:13:24.559926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 30/57] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:24 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:24.595790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:24.603547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b55c369c-3708-477e-820d-dad972aeb95f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.206048 Jun 02 10:13:24.604649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 28/58] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:24 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:24.961280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:24.961947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:24.967998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.968449 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:24.969219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:24.969657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:25.062082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:25.069867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5af1700c-f569-4bbd-af22-850d71331756 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.112396 Jun 02 10:13:25.070886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 31/59] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:24 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:25.576564 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:25.578506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:25.585622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:25.586076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:25.587252 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:25.587834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:25.627118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:25.632170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:25.632170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:25.638313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:25.640527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:25.643018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:25.644144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:25.687314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=67 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:25.798631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:25.807741 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3ef53154-3723-4519-add4-dd00250eb594 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.235095 Jun 02 10:13:25.817268 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 29/60] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:25 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:25.882249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:25.893778 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b4e53b6f-e16c-4a6c-8888-33d8a6d8bd12 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.276848 Jun 02 10:13:25.894540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 32/61] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:25 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:26.086862 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:26.087674 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:26.095596 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.096737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:26.097994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.098926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:26.177660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:26.186992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7869e8c1-2c3a-468e-a951-ced76c58e362 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.103500 Jun 02 10:13:26.187910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 30/62] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:26 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:26.830509 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:26.831320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:26.847938 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.848590 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:26.849466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.849980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:26.918865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:26.919689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:26.923185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=4 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:26.933449 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.934289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:26.936082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:26.938075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:27.258157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:27.263162 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-55c65d69-52ee-4bad-bae8-a24591fce456 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.349787 Jun 02 10:13:27.271405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 31/63] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:26 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:27.278335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:27.279884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:27.299582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:27.304997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:27.305676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:27.306607 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:27.307791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:27.393244 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:27.406426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-30721d9b-456d-470a-a230-d3af0d2abc6c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.584095 Jun 02 10:13:27.423609 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 33/64] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:26 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:27.916759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:27.924994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bfa2ece9-b797-4d71-9541-d32de5cd6be9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1244 microversion: 2.1 time: 0.652287 Jun 02 10:13:27.927189 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 32/65] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:27 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1244 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:28.290072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:28.290846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:28.303008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.304544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.305694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.320791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.426485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:28.428611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:28.438545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.440541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.443327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.444698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.604802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:28.651932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:28.660955 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-495b5fe4-188f-4dee-80a9-3df65a12d17c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.375794 Jun 02 10:13:28.665039 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:28 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:28.702905 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:28.710346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f170eea7-18db-4c15-8885-4686d40ff6fa tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.290142 Jun 02 10:13:28.710974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:28 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:28.944708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:28.946347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:28.957475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.958117 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.959315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:28.960004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:28.993285 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-b634a54f-5e15-45a4-8425-ce3a7f978ce8 req-cad9ff28-7871-479f-96a9-96f2c44bd18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "018f9347-694c-4dcd-84c1-190b2b829067", "tag": "7e154b60-05d7-41bf-adef-be1c10a169b0"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:29.004648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b634a54f-5e15-45a4-8425-ce3a7f978ce8 req-cad9ff28-7871-479f-96a9-96f2c44bd18d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.005082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b634a54f-5e15-45a4-8425-ce3a7f978ce8 req-cad9ff28-7871-479f-96a9-96f2c44bd18d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.024032 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:29.024194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-b634a54f-5e15-45a4-8425-ce3a7f978ce8 req-cad9ff28-7871-479f-96a9-96f2c44bd18d service nova] Creating event network-changed:7e154b60-05d7-41bf-adef-be1c10a169b0 for instance 018f9347-694c-4dcd-84c1-190b2b829067 on hv-cinder-79760 Jun 02 10:13:29.024578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b634a54f-5e15-45a4-8425-ce3a7f978ce8 req-cad9ff28-7871-479f-96a9-96f2c44bd18d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 02 10:13:29.025640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.026644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.027451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.027881 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.032495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b0c1db39-3f73-49b2-8dc8-47f74745d8b7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1292 microversion: 2.1 time: 0.092172 Jun 02 10:13:29.035134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:28 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:29.037685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.compute.rpcapi [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 02 10:13:29.038738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 02 10:13:29.054620 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-734a9072-ee85-42ab-8ef0-00f8e0a844a7 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128485 Jun 02 10:13:29.057229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 35/69] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:29.677584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:29.678330 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:29.686054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.688372 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.689252 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.689758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.727215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:29.728043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:29.738106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.740288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:29.741264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:29.741910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:30.003670 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:30.012806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b34e512b-8735-40c5-8abc-11b42fd1856f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.338889 Jun 02 10:13:30.021844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 35/70] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:29 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:30.060048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:30.064367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:30.075618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:30.076160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:30.077688 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:30.078204 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:30.121716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:30.131136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9722e4cc-3567-440e-bd0d-2dcfae468ba7 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.408124 Jun 02 10:13:30.131747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 36/71] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:29 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:30.147428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:30.156103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2b4ab2e8-6aa8-4ac8-a70b-e3fd05c76309 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1300 microversion: 2.1 time: 0.109284 Jun 02 10:13:30.156678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 36/72] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:30 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:31.030286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:31.030908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:31.032879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=22 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:31.037797 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.038261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.039077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.039641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.149139 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:31.150560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:31.159048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.163275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.164387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.165153 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.201872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:31.210652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-284d8402-b135-4942-8c3b-2bb7c28ee350 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.185197 Jun 02 10:13:31.211226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 37/73] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:31 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:31.219159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:31.219858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:31.226747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.227373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.228264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:31.228819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:31.310986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:31.325074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0550b080-c1f6-4c11-8a53-7dada6f64818 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1310 microversion: 2.1 time: 0.112286 Jun 02 10:13:31.325805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 38/74] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:31 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:31.343537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:31.361596 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a9a33ec3-7613-4efb-863e-9c0bf0efa3f0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.216974 Jun 02 10:13:31.363540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 37/75] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:31 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:32.229118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:32.229118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:32.234622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.235071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.235870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.236306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.343454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:32.344952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:32.352188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.352800 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.353714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.354285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.398033 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:32.405536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1e4226aa-a169-4da1-9dcc-e30715ec85ea tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.182143 Jun 02 10:13:32.406102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:32 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:32.410622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:32.411407 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:32.417546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.418352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.418737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:32.419290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:32.424134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:32.428329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-162729c4-498d-43aa-9a74-5cbf51afd236 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1310 microversion: 2.1 time: 0.089919 Jun 02 10:13:32.428974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:32 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:32.670238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:32.679742 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1f49d441-cf63-471e-870d-6b574ca2fd66 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.272260 Jun 02 10:13:32.680249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 40/78] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:32 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:33.421756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:33.422371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:33.428373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.428826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.429597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.430035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.445525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:33.446720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:33.453377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.453994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.454912 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.455520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.522072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:33.530337 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5429df52-5a20-42a6-8f2c-d827e323b289 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1310 microversion: 2.1 time: 0.088562 Jun 02 10:13:33.531020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 41/79] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:33 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:33.572228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:33.608571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4f1c2746-3a7d-462a-88b5-3dc6a9e478a9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.188959 Jun 02 10:13:33.619949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:33 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:33.698633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:33.699506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:33.705971 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.706619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.707519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:33.707964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:33.930223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:33.940361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f13cc3d5-5bb7-498b-b2d8-a6509f6657db tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.246308 Jun 02 10:13:33.940944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 42/81] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:33 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:34.547385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:34.547961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:34.553865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.557854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:34.557854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.557854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:34.626275 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:34.626880 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:34.633824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.638292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:34.638292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.638292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:34.697043 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:34.705248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e4b4b27f-0aae-4a5c-9c3b-b29e555e06c3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.161763 Jun 02 10:13:34.709504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 40/82] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:34 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:34.899385 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:34.907445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-24e57694-a3f7-4c72-a832-6e756a3e6a72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.285135 Jun 02 10:13:34.908011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 43/83] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:34 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:34.957958 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:34.958694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:34.965444 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.965899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:34.966693 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:34.967151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:35.157314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:35.162883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bc390a15-4cf4-4885-a228-e12e99b22161 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.208966 Jun 02 10:13:35.163474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 41/84] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:34 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:35.732424 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:35.733032 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:35.739320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:35.739773 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:35.740599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:35.741038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:35.881715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:35.889190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c95d5640-f292-4598-b73b-79ead24aeb4e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.161009 Jun 02 10:13:35.889937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 44/85] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:35 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:35.924749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:35.925964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:35.933962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:35.934688 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:35.935506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:35.936010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:36.111464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:36.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-803bda51-ac18-4a2d-bad9-dc6d7045d142 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.198939 Jun 02 10:13:36.120494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 42/86] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:35 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:36.179430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:36.180044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:36.186177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:36.186638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:36.187429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:36.188030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:36.320126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:36.332271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c4e5ea13-f003-4402-9c6a-324b168009c1 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.156522 Jun 02 10:13:36.333325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 45/87] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:36 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:36.905893 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:36.906586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:36.913289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:36.915877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:36.915877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:36.915877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:37.073582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:37.080543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f3649bbc-b2a3-4a27-94a7-27d8ce5ba737 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.178620 Jun 02 10:13:37.081271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 43/88] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:36 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:37.137242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:37.137846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:37.144463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:37.144908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:37.145667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:37.146095 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:37.276473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:37.283851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f6f0f396-99de-4dd0-a8b7-c8494f608793 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.150502 Jun 02 10:13:37.284417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:37 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:37.349681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:37.352195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:37.360161 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:37.360607 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:37.361541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:37.362128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:37.383831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:37.504646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:37.512587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-30bfd131-5d6c-4160-aa2e-99c6a91697c5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.167033 Jun 02 10:13:37.513374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 44/90] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:37 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:38.106048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:38.106796 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:38.113032 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.113573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.114412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.114925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.247740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:38.255231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d13e446f-5077-4db7-b97c-7e5b2fa05188 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.153360 Jun 02 10:13:38.255782 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:38 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:38.300682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:38.301525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:38.308497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.308956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.309737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.310181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.532570 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:38.533180 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:38.540393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.540850 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.542161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.542596 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.584379 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:38.592589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8bff8e24-0e07-43fd-ba18-e65239689060 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.295583 Jun 02 10:13:38.604258 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:38 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:38.692374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:38.700008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5878ed37-1d21-41b0-8f02-613f764058e6 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.174996 Jun 02 10:13:38.700585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:38 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:38.943473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-75155196-bb00-4654-be03-c857f148abf9 req-0d372f13-446d-437d-a359-df203a339507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc80296-c07d-44ee-af27-e0b80e3a3b4b", "name": "network-vif-plugged", "status": "completed", "tag": "2fc033ee-39b2-473c-8a55-ebe57d07c7c3"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:38.951689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-75155196-bb00-4654-be03-c857f148abf9 req-0d372f13-446d-437d-a359-df203a339507 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:38.952369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-75155196-bb00-4654-be03-c857f148abf9 req-0d372f13-446d-437d-a359-df203a339507 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:38.973102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-75155196-bb00-4654-be03-c857f148abf9 req-0d372f13-446d-437d-a359-df203a339507 service nova] Creating event network-vif-plugged:2fc033ee-39b2-473c-8a55-ebe57d07c7c3 for instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b on hv-cinder-79760 Jun 02 10:13:38.978560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-75155196-bb00-4654-be03-c857f148abf9 req-0d372f13-446d-437d-a359-df203a339507 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098120 Jun 02 10:13:38.979971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 46/94] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:39.272922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:39.273534 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:39.280115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.280562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.281316 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.281747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.301813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:39.480438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:39.487764 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f58bcb30-5c48-4272-b2ff-08fed6174993 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.218702 Jun 02 10:13:39.488406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:39 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:39.615292 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:39.616136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:39.623225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.623739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.624515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.624957 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.726280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:39.726911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:39.740210 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:39.742960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.743451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.744233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:39.753033 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:39.772886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:39.781715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2115ac10-accd-443b-8ac9-343e5d7cad1e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.170696 Jun 02 10:13:39.782713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 47/96] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:39 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:39.938898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:39.946487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-96a54e6e-2642-415c-ac9e-39aed14788f3 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.231572 Jun 02 10:13:39.957204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:39 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:40.364765 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-f62b455a-beb9-45fe-9918-bb7ec368c7e4 req-cd38ff34-c205-4486-966a-a6f8166d98c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480d49c3-9724-40e7-a993-e9bf6ee926fb", "tag": "c8e6335f-c5c8-4521-8d81-dd0d93e17834"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:40.380650 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-f62b455a-beb9-45fe-9918-bb7ec368c7e4 req-cd38ff34-c205-4486-966a-a6f8166d98c8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.381109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-f62b455a-beb9-45fe-9918-bb7ec368c7e4 req-cd38ff34-c205-4486-966a-a6f8166d98c8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.394340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-f62b455a-beb9-45fe-9918-bb7ec368c7e4 req-cd38ff34-c205-4486-966a-a6f8166d98c8 service nova] Creating event network-changed:c8e6335f-c5c8-4521-8d81-dd0d93e17834 for instance 480d49c3-9724-40e7-a993-e9bf6ee926fb on hv-cinder-79760 Jun 02 10:13:40.399455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-f62b455a-beb9-45fe-9918-bb7ec368c7e4 req-cd38ff34-c205-4486-966a-a6f8166d98c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038517 Jun 02 10:13:40.400053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 48/98] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:40.505354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:40.506160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:40.515650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.515650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.515650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.515650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.685364 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:40.693859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d71644a4-f8e2-4c9f-abca-293eb85a8ae5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.192522 Jun 02 10:13:40.694433 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:40 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:40.799407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:40.800134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:40.806279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.806738 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.807556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.807987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.941809 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:40.949822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-58e2c9b0-a97d-4626-aade-b39c58a5b159 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.154648 Jun 02 10:13:40.950390 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:40 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:40.965409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:40.966028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:40.972002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.972517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:40.973292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:40.973733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:41.121355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:41.128884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f2fde777-751e-4095-b40a-b52f19da98a0 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.168588 Jun 02 10:13:41.129452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:40 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:41.715974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:41.717038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:41.744803 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:41.749880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:41.751499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:41.754153 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:41.970737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:41.974347 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:41.991903 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:41.998418 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:42.000111 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:42.001573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:42.085654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:42.099561 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-98b9c77e-13a0-4a20-b7dc-3072b96775ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.391396 Jun 02 10:13:42.101026 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 50/102] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:41 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:42.145974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:42.147121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:42.154054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:42.154877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:42.155918 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:42.156563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:42.335649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:42.344004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-66678c11-54b9-4762-916c-e27c85e99863 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.201932 Jun 02 10:13:42.344579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 51/103] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:42 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:42.404497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:42.418799 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-337b6cf6-77df-469c-b8bf-b177d322e5c4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.455575 Jun 02 10:13:42.424070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:41 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:43.127541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:43.127541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:43.133647 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.134095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.135427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.135865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.278960 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:43.279223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2aaf2e00-68f0-4558-af94-209f4f5e043a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.158942 Jun 02 10:13:43.279798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 52/105] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:43 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:43.362361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:43.363804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:43.379610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.383482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.387741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.387741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.440945 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:43.441568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:43.448676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.449016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.450905 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:43.454591 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:43.562396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:43.573111 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9ce6bfec-b878-4cf2-aa19-a7ff6f3aad47 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.215189 Jun 02 10:13:43.576778 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 54/106] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:43 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:43.626443 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:43.634167 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7cd051fe-feb1-4653-9ea3-2b0d54dc275a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.198119 Jun 02 10:13:43.635524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 53/107] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:43 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:44.308328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:44.308959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:44.318297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.318753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.319574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.320017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.466798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:44.475556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7798d965-4c2b-40f8-bcea-1c498753e26c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.182418 Jun 02 10:13:44.478324 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 55/108] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:44 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:44.596918 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:44.598228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:44.606502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.607276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.608853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.610357 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.652695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:44.653417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:44.661081 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.661815 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.662947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:44.663648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:44.926722 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:44.938392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1291e390-4d77-49bd-ad81-2e6953dc1a83 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.290673 Jun 02 10:13:44.942022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 56/109] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:44 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:44.974691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:44.987401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-eaf39822-5374-451a-b1ae-85e100626efc tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.396617 Jun 02 10:13:44.988289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:44 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:45.037272 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-d0609a1d-a248-4715-9286-1ad5a97b60b7 req-8d796756-7d0f-4ad6-acd7-719013180cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd186230-f6d5-41ad-abf4-ff9671465a29", "name": "network-vif-plugged", "status": "completed", "tag": "dc2364a5-75e4-4d94-9213-794f385c71db"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:45.045654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d0609a1d-a248-4715-9286-1ad5a97b60b7 req-8d796756-7d0f-4ad6-acd7-719013180cad service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:45.046099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d0609a1d-a248-4715-9286-1ad5a97b60b7 req-8d796756-7d0f-4ad6-acd7-719013180cad service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:45.059647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-d0609a1d-a248-4715-9286-1ad5a97b60b7 req-8d796756-7d0f-4ad6-acd7-719013180cad service nova] Creating event network-vif-plugged:dc2364a5-75e4-4d94-9213-794f385c71db for instance cd186230-f6d5-41ad-abf4-ff9671465a29 on hv-cinder-79760 Jun 02 10:13:45.064845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-d0609a1d-a248-4715-9286-1ad5a97b60b7 req-8d796756-7d0f-4ad6-acd7-719013180cad service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Jun 02 10:13:45.065447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 57/111] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:13:45.493938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:45.495241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:45.501502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:45.501875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:45.502643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:45.503080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:45.676449 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:45.684970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a9371c54-fd1d-4afe-9f97-ae8841132432 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.194817 Jun 02 10:13:45.685545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:45 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:45.958734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:45.959679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:45.967311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:45.968090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:45.969015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:45.969741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:46.007909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:46.008961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:46.016613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:46.017071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:46.017854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:46.018741 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:46.153715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:46.172556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1c98eaaa-9ece-4690-afd2-80408ac97162 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.218149 Jun 02 10:13:46.178061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:46.186485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-816b8d83-bf4a-455f-9389-dd199180832b tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.185169 Jun 02 10:13:46.186901 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 58/113] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:45 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:46.187623 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 56/114] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:46 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:46.703249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:46.704124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:46.711238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:46.711937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:46.712931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:46.713516 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:46.868116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:46.880455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8b6baa81-343a-407c-a77b-c34f7d73f1cd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.181793 Jun 02 10:13:46.881518 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 59/115] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:46 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:47.080778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-0477efb9-c688-4a8d-b43a-ac14e2f0439f req-b9eec61e-b9de-44a5-af44-23a740caff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018f9347-694c-4dcd-84c1-190b2b829067", "name": "network-vif-plugged", "status": "completed", "tag": "7e154b60-05d7-41bf-adef-be1c10a169b0"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:47.089090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-0477efb9-c688-4a8d-b43a-ac14e2f0439f req-b9eec61e-b9de-44a5-af44-23a740caff4f service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.089622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-0477efb9-c688-4a8d-b43a-ac14e2f0439f req-b9eec61e-b9de-44a5-af44-23a740caff4f service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.100598 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-0477efb9-c688-4a8d-b43a-ac14e2f0439f req-b9eec61e-b9de-44a5-af44-23a740caff4f service nova] Creating event network-vif-plugged:7e154b60-05d7-41bf-adef-be1c10a169b0 for instance 018f9347-694c-4dcd-84c1-190b2b829067 on hv-cinder-79760 Jun 02 10:13:47.106243 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-0477efb9-c688-4a8d-b43a-ac14e2f0439f req-b9eec61e-b9de-44a5-af44-23a740caff4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029222 Jun 02 10:13:47.106881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 57/116] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:47.193811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:47.194521 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:47.201001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.201845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.202612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.203243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.206579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:47.207560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:47.214281 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.214792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.215773 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.216361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.356776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:47.365123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-15f8ce7b-5adc-4b59-ab5e-38a0013e2d89 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.175259 Jun 02 10:13:47.367308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 60/117] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:47 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:47.405342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:47.413812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-aed628ca-05f1-4e8b-82f4-cc03400e3455 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.210912 Jun 02 10:13:47.419314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 58/118] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:47 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:47.898304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:47.898919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:47.905026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.905489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:47.906249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:47.906675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:48.224350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:48.234971 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6f3e0493-3edd-4d98-bf24-b496bf3bb90f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.340817 Jun 02 10:13:48.235911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 61/119] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:47 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:48.383427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:48.384090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:48.390115 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:48.390599 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:48.391399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:48.391842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:48.429686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:48.430296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:48.437117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:48.437563 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:48.438332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:48.438899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:48.540439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:48.548799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4a3c02cd-a153-4bef-8633-4913849542f7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.169285 Jun 02 10:13:48.549385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 59/120] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:48 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:48.580919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:48.588521 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6d249802-76e6-4d28-9bab-abeeec636192 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.162750 Jun 02 10:13:48.589227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:48 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:49.268148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:49.271799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:49.279280 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.279742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.280531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.280968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.440412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:49.447830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2f7d4c61-23e9-4df3-9c16-223b73eb4cb2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.191858 Jun 02 10:13:49.448394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:49 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:49.565724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:49.566333 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:49.573810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.574307 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.576812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.577258 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.606682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:49.607580 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:49.615308 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.615821 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.616857 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:49.617525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:49.753519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:49.764838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a2ce99c4-a1eb-4165-9db9-4b5542fbb6b8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.202361 Jun 02 10:13:49.774651 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 63/123] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:49 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:49.796999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:49.805001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4ee486a0-78b9-4025-88df-1822777a4901 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.203513 Jun 02 10:13:49.805570 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 61/124] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:49 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:50.464819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:50.465408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:50.471302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.471749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.472499 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.472925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.607641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:50.615309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-766f19c5-5bb6-42a1-b275-b677162c9c47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.154137 Jun 02 10:13:50.615870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 64/125] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:50 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:50.780882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:50.781558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:50.788298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.788783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.789561 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.790003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.821866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:50.827241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:50.828882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.829338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.830114 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:50.830555 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:50.962339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:50.964156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:50.972569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5eabb4da-26df-4744-9aac-fe6bfde1dee0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.195087 Jun 02 10:13:50.973469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-678b0a55-95d9-491d-a1ae-52af63406f95 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1314 microversion: 2.1 time: 0.155372 Jun 02 10:13:50.973809 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 62/126] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:50 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:50.975396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 65/127] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:50 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:51.632817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:51.633350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:51.639924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:51.640367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:51.641120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:51.641578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:51.645643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.809754 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:51.817060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8e56bad3-61d8-44ac-80a0-c3a94f8983c0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.188138 Jun 02 10:13:51.817612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 63/128] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:51 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:51.989971 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:51.990663 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:51.990901 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:51.991562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:51.998310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:51.998959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:51.999246 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:51.999865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:52.000628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:52.000738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:52.001185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:52.001301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:52.182959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:52.185254 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.192064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9c8f842a-5da3-41a3-a757-a44d46fd69fb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.206330 Jun 02 10:13:52.192647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 66/129] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:51 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:52.211531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:52.218949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5a987076-507d-4222-968a-f9ed5b377bd5 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1501 microversion: 2.1 time: 0.231860 Jun 02 10:13:52.219548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 64/130] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:51 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:52.834069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:52.834755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:52.842077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:52.842553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:52.843345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:52.844119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:52.979936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:52.987878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e854e472-6ff1-4cae-a2ef-0fc270e5b761 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.157734 Jun 02 10:13:52.988485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 67/131] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:52 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:53.208662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:53.209746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:53.216071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:53.216576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:53.220958 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:53.220958 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:53.416850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:53.416850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e2ba64d8-11bf-4cb1-9238-ff1eab043dcd tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.211287 Jun 02 10:13:53.416850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 65/132] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:53 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:54.005257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:54.005934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:54.012571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:54.013084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:54.013848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:54.014287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:54.153186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:54.161975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dc7b585b-dc0d-4c46-86ad-6572d02d4eb6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.160481 Jun 02 10:13:54.163353 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 68/133] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:54 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:54.434087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:54.434559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:54.440943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:54.441474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:54.442363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:54.443140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:54.577217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:54.584500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dc3573f1-cad8-4f43-9e95-db424b7964a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.155429 Jun 02 10:13:54.585113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 66/134] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:54 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:55.178907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:55.179550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:55.186135 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:55.186587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:55.187419 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:55.187854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:55.327520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:55.335130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6536b75f-b47d-425d-a585-026858214961 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.159963 Jun 02 10:13:55.335717 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:55 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:55.601083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:55.601743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:55.608433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:55.608880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:55.609646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:55.610087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:55.739792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:55.748076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-706fee39-2ca8-45e4-a9e0-e86301c76f73 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.150844 Jun 02 10:13:55.748647 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 67/136] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:55 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:55.758500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-37d49270-1084-4d1a-8373-9cb3385e28b2 req-55ec4ac3-f68b-4e21-8a04-7844f9bce9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480d49c3-9724-40e7-a993-e9bf6ee926fb", "name": "network-vif-plugged", "status": "completed", "tag": "c8e6335f-c5c8-4521-8d81-dd0d93e17834"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:55.768712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-37d49270-1084-4d1a-8373-9cb3385e28b2 req-55ec4ac3-f68b-4e21-8a04-7844f9bce9a3 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:55.769153 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-37d49270-1084-4d1a-8373-9cb3385e28b2 req-55ec4ac3-f68b-4e21-8a04-7844f9bce9a3 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:55.781533 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-37d49270-1084-4d1a-8373-9cb3385e28b2 req-55ec4ac3-f68b-4e21-8a04-7844f9bce9a3 service nova] Creating event network-vif-plugged:c8e6335f-c5c8-4521-8d81-dd0d93e17834 for instance 480d49c3-9724-40e7-a993-e9bf6ee926fb on hv-cinder-79760 Jun 02 10:13:55.786565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-37d49270-1084-4d1a-8373-9cb3385e28b2 req-55ec4ac3-f68b-4e21-8a04-7844f9bce9a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031761 Jun 02 10:13:55.787212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 70/137] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:13:56.357679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:56.357679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:56.364594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:56.365286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:56.366569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:56.367797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:56.519207 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:56.526682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9061af38-8b5d-4b8f-ae76-11431ada9bf7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.178459 Jun 02 10:13:56.527282 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 68/138] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:56 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:56.764955 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:56.766289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:56.773663 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:56.774218 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:56.774872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:56.775566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:56.920515 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:56.928112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-951e87c7-f848-4124-8b34-a2dc46aa6f93 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.167442 Jun 02 10:13:56.928672 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 71/139] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:56 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:57.543814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:57.544406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:57.550342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:57.550788 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:57.551662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:57.552127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:57.692163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:57.698190 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4ccab0ef-4bf0-4fa4-bf10-1f465c4912ea tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.158236 Jun 02 10:13:57.698821 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 69/140] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:57 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:57.944349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:57.944998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:57.951644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:57.952100 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:57.952878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:57.953374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:58.081099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:58.089445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-47902776-37fc-410e-96db-b79df0645702 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1321 microversion: 2.1 time: 0.148931 Jun 02 10:13:58.090197 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 72/141] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:57 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:58.132413 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70d9e9b4-a607-44d3-9eda-f988f256bc6a"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:58.133555 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:58.139577 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:58.140029 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:58.140790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:58.141220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:58.715484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:58.716130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:58.719247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=82 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.723252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:58.723735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:58.724513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:58.724941 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:58.872159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:58.877811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d1ebbf6b-1a81-4df7-8441-b4d56ef3875f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.166704 Jun 02 10:13:58.878379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:58 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:13:59.105633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:59.106283 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:59.112786 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.113231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.113996 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.114432 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.425335 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:13:59.433301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e1c708a7-7334-4e75-b094-5c76037b8e65 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1515 microversion: 2.1 time: 0.331575 Jun 02 10:13:59.441183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:59 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:13:59.450378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:13:59.451442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:59.457271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.457731 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.458489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.458928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.520179 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'flavor' on Instance uuid 018f9347-694c-4dcd-84c1-190b2b829067 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:13:59.848284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-19807397-94da-4740-8c9e-c5dbee75bf5e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067/action" status: 200 len: 32 microversion: 2.1 time: 0.402125 Jun 02 10:13:59.852613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 75/144] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:13:59 2022] POST /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 10:13:59.859003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:13:59.859764 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:13:59.866026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.866478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.867291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:13:59.867735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:13:59.994569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:00.002153 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4ee9ab19-89cd-44a0-8ce9-b79ebe869e27 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.147474 Jun 02 10:14:00.002706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 76/145] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:13:59 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:00.007025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:00.007644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:00.013298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:00.013752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:00.014545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:00.014984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:00.146704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:00.155273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-23ccb649-6273-499f-a41f-d838035092c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.151534 Jun 02 10:14:00.155847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 77/146] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:00 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:01.019146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:01.019710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:01.026042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:01.026500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:01.027334 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:01.027774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:01.162390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:01.170598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d5d3094e-832a-42dd-8da3-06248dd50689 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.155396 Jun 02 10:14:01.171174 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 78/147] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:01 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:01.175490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:01.176076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:01.182198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:01.182637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:01.183441 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:01.183850 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:01.324023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:01.331299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6deb3527-21d7-4899-82f2-c2839ccf36e0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.159154 Jun 02 10:14:01.331863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 79/148] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:01 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:02.186741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:02.187397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:02.193465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:02.193907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:02.194654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:02.195084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:02.336351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:02.344060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0ebab538-b2cf-4298-922e-061d16050524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.161026 Jun 02 10:14:02.344663 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 80/149] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:02 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:02.349299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:02.349928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:02.356074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:02.356528 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:02.357299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:02.357739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:02.488435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:02.496708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-050aeaf2-ea42-4c94-99d7-2a9c32118979 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1365 microversion: 2.1 time: 0.150873 Jun 02 10:14:02.497290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 81/150] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:02 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:03.360993 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:03.361715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:03.370843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.371330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.372550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.372984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.377567 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:03.513402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:03.521648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c2efe5d3-b8bf-4662-8292-6cd96cda9a17 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.164798 Jun 02 10:14:03.531542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 82/151] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:03 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:03.536497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:03.537201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:03.543270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.543794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.544643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.545127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.676278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:03.685152 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-49502bc5-cac8-48e8-a346-d22b1385a5b1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1555 microversion: 2.1 time: 0.152501 Jun 02 10:14:03.685930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 83/152] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:03 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:03.702346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:03.706944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:03.708766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.709207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.709960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:03.710393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:03.790717 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bbf09414-ea6d-4b28-bed1-524c20f82b8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092046 Jun 02 10:14:03.793231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 84/153] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:14:03 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:14:04.057840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-04845480-96e6-41f2-b9fb-88ed4ffc2f57 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "POST /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.929389 Jun 02 10:14:04.058650 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 70/154] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:13:58 2022] POST /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b/os-volume_attachments => generated 194 bytes in 5931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:14:04.538454 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:04.539345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:04.554298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:04.555078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:04.559203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:04.559203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:05.135285 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:05.152630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-38ebdd33-ad4f-49d5-b0da-6ff27077cdd0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.618222 Jun 02 10:14:05.153223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 85/155] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:04 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:05.924225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-d0f7051b-24ac-4ce5-910e-8d2928ca869a req-1e28b497-897e-4e73-bf6a-5fb51882b3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480d49c3-9724-40e7-a993-e9bf6ee926fb", "tag": "c8e6335f-c5c8-4521-8d81-dd0d93e17834"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:05.929114 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=77 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.934475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d0f7051b-24ac-4ce5-910e-8d2928ca869a req-1e28b497-897e-4e73-bf6a-5fb51882b3a4 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:05.934475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d0f7051b-24ac-4ce5-910e-8d2928ca869a req-1e28b497-897e-4e73-bf6a-5fb51882b3a4 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:05.944641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-d0f7051b-24ac-4ce5-910e-8d2928ca869a req-1e28b497-897e-4e73-bf6a-5fb51882b3a4 service nova] Creating event network-changed:c8e6335f-c5c8-4521-8d81-dd0d93e17834 for instance 480d49c3-9724-40e7-a993-e9bf6ee926fb on hv-cinder-79760 Jun 02 10:14:05.949719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-d0f7051b-24ac-4ce5-910e-8d2928ca869a req-1e28b497-897e-4e73-bf6a-5fb51882b3a4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030360 Jun 02 10:14:05.950818 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 71/156] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:14:06.169838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:06.170436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:06.185382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:06.191615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:06.192431 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:06.192877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:06.590427 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:06.602538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1d6d3f4f-603b-4083-8f3e-f125d9da2602 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.437282 Jun 02 10:14:06.604895 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 86/157] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:06 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:07.624131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:07.625683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:07.633832 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:07.634324 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:07.635118 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:07.635555 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:07.769128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:07.777385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8daa5cc1-5713-41a0-9a65-af185245ba09 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.159130 Jun 02 10:14:07.777962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 72/158] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:07 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:08.794222 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:08.794832 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:08.801148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:08.801600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:08.802373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:08.802838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:09.122518 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:09.137872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-11fd5ad8-adbc-40d5-92fa-fb60516733b0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.347636 Jun 02 10:14:09.138711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 87/159] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:08 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:10.155959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:10.157127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:10.170196 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:10.170702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:10.171568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:10.172014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:10.338466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:10.348851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ac231567-a045-45d0-a3ad-57a0bad7363d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.197830 Jun 02 10:14:10.359137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 73/160] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:10 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:11.366260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:11.366871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:11.374059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:11.374500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:11.375506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:11.375934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:11.527323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:11.529600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a75ec916-fa68-4703-8b06-8de7cc30c213 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.167172 Jun 02 10:14:11.530174 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 88/161] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:11 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:12.545627 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:12.546248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:12.553658 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:12.553946 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:12.555068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:12.559221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:12.699527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:12.710996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-50fc6160-3fd0-4fa9-a559-cb8d92a3513c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.165676 Jun 02 10:14:12.710996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 74/162] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:12 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:13.729264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:13.730805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:13.737487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:13.738261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:13.739383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:13.739890 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:13.876634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:13.884458 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b6ab67f8-97e9-48ba-8e69-52b695cba5a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.162060 Jun 02 10:14:13.891407 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 89/163] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:13 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:14.901321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:14.901925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:14.908321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:14.908763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:14.909511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:14.909943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:15.043836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:15.052436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4bd60bfd-f3ec-4370-b32e-591c0acd50c3 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.155374 Jun 02 10:14:15.067297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 75/164] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:14 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:16.074693 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:16.075296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:16.081897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.082342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.083127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.083555 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.218496 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:16.226182 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-75bba62c-d658-4c80-834b-f993ed031e81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.155424 Jun 02 10:14:16.226747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 90/165] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:16 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:16.458037 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:16.459719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:16.469057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.469595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.470804 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.471354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.500617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:14:16.764285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9fd7192d-81c0-4c0e-ba05-138868c9b377 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 204 len: 0 microversion: 2.1 time: 0.311531 Jun 02 10:14:16.770549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 76/166] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:14:16 2022] DELETE /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:14:16.778919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:16.779566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:16.788868 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.789317 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.790207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:16.790581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:16.934417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:16.948752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-207c2b78-962f-44d6-9f5a-5923f7491a48 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1553 microversion: 2.1 time: 0.167138 Jun 02 10:14:16.948752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 91/167] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:16 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:17.244064 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:17.244801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:17.250937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:17.251408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:17.252192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:17.252630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:17.272265 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:17.384794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:17.392733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3d483ca5-f5a6-45e5-b126-7d122850340e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.152920 Jun 02 10:14:17.393302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 77/168] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:17 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:17.959874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:17.960512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:17.966456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:17.966909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:17.967701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:17.968141 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:18.096396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:18.104767 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-393d94b6-15be-43e6-8332-0d8003ff0ca4 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1553 microversion: 2.1 time: 0.148795 Jun 02 10:14:18.105439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 92/169] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:17 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:18.410001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:18.410681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:18.424482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:18.424482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:18.424482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:18.424482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:18.595532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:18.610881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7bcbb624-aa24-4b02-97f1-59165ba2fb5a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.204671 Jun 02 10:14:18.615138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 78/170] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:18 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:19.122177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:19.122792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:19.129077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:19.129531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:19.130302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:19.130742 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:19.357170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:19.369249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-051fdf9d-a344-4b2b-859b-96acae4965ac tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1553 microversion: 2.1 time: 0.248419 Jun 02 10:14:19.370706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 93/171] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:19 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:19.628976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:19.629618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:19.637636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:19.638095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:19.638868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:19.639346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:19.747231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-05d93b0c-a4a5-45b7-8434-97901ab589dc req-41f48dc2-4dcf-4b4a-957c-929172824d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc80296-c07d-44ee-af27-e0b80e3a3b4b", "name": "network-vif-deleted", "tag": "2fc033ee-39b2-473c-8a55-ebe57d07c7c3"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:19.758198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-05d93b0c-a4a5-45b7-8434-97901ab589dc req-41f48dc2-4dcf-4b4a-957c-929172824d75 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:19.758198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-05d93b0c-a4a5-45b7-8434-97901ab589dc req-41f48dc2-4dcf-4b4a-957c-929172824d75 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:19.769119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-05d93b0c-a4a5-45b7-8434-97901ab589dc req-41f48dc2-4dcf-4b4a-957c-929172824d75 service nova] Creating event network-vif-deleted:2fc033ee-39b2-473c-8a55-ebe57d07c7c3 for instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b on hv-cinder-79760 Jun 02 10:14:19.777581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-05d93b0c-a4a5-45b7-8434-97901ab589dc req-41f48dc2-4dcf-4b4a-957c-929172824d75 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Jun 02 10:14:19.778188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 94/172] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:14:19.799748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:19.807866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ac103c45-3e69-48f1-82e0-290059f83ac9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.182305 Jun 02 10:14:19.808667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 79/173] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:19 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:20.388482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:20.389191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:20.395604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:20.396114 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:20.398225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:20.398225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:20.462563 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea254e4bdc142b9ae1767335fd84d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0025aa9f920f45729d8516c9e315e448', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:20.471255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ff62820a-559f-4c82-a592-5a23257aef58 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 200 len: 1345 microversion: 2.1 time: 0.088210 Jun 02 10:14:20.471820 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 95/174] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:20 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:20.826445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:20.827499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:20.841216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:20.841216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:20.841216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:20.843535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:21.239251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:21.248288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7417dc36-9fee-4da8-b5b9-795dd9e4a02c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.427720 Jun 02 10:14:21.249046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 80/175] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:20 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:21.487732 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:21.488371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:21.494313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:21.495494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:21.496257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:21.496691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:21.510286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] HTTP exception thrown: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Request method failure captured: Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b HTTP/1.1 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI0qCHkr1IEeEruiQcT7MCbeZEACIUceOUegt4wXRiErMDkJUTIPN2VafINVStwpkkpvonjJhu2i8TUJgkXrU5m_7A_jBpsOx-TzNcjgKCue20zHj_qA_ZgmYroAzFehW-5PIgHQJr9Ug5FVfClFCkt9aajplTivFBthulX0ZqmNmHM Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:14:21.514750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0025aa9f920f45729d8516c9e315e448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: aea254e4bdc142b9ae1767335fd84d61 Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.516145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '2fc80296-c07d-44ee-af27-e0b80e3a3b4b'} Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:14:21.516884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.518216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.519217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Returning 404 to user: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:14:21.519217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ecf59a47-e4fb-44af-9d5b-dacb4e75b123 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 404 len: 111 microversion: 2.1 time: 0.032470 Jun 02 10:14:21.519217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 96/176] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:21 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:14:21.619583 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:21.623211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:21.627665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:21.628202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:21.629043 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:21.629557 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:21.644583 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] HTTP exception thrown: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Request method failure captured: Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b/os-volume_attachments HTTP/1.1 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI0qCHkr1IEeEruiQcT7MCbeZEACIUceOUegt4wXRiErMDkJUTIPN2VafINVStwpkkpvonjJhu2i8TUJgkXrU5m_7A_jBpsOx-TzNcjgKCue20zHj_qA_ZgmYroAzFehW-5PIgHQJr9Ug5FVfClFCkt9aajplTivFBthulX0ZqmNmHM Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:14:21.650004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0025aa9f920f45729d8516c9e315e448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: aea254e4bdc142b9ae1767335fd84d61 Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.662974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'server_id': '2fc80296-c07d-44ee-af27-e0b80e3a3b4b'} Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:14:21.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:21.665269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:21.666304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Returning 404 to user: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:14:21.666304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-12b4af85-612b-489e-827e-12bb81c1a76a tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037521 Jun 02 10:14:21.666304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 81/177] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:14:21 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:14:22.265209 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:22.265998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:22.272255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:22.272711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:22.273480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:22.273923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:22.429989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:22.443022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dd1e7995-3dcf-46a5-813e-e87d436c02e4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.178038 Jun 02 10:14:22.443022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 97/178] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:22 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:23.079183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:23.079731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:23.089819 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.090282 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.091057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.091692 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.105407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] HTTP exception thrown: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Request method failure captured: Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b HTTP/1.1 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI0qCHkr1IEeEruiQcT7MCbeZEACIUceOUegt4wXRiErMDkJUTIPN2VafINVStwpkkpvonjJhu2i8TUJgkXrU5m_7A_jBpsOx-TzNcjgKCue20zHj_qA_ZgmYroAzFehW-5PIgHQJr9Ug5FVfClFCkt9aajplTivFBthulX0ZqmNmHM Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:14:23.107601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0025aa9f920f45729d8516c9e315e448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: aea254e4bdc142b9ae1767335fd84d61 Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.109774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '2fc80296-c07d-44ee-af27-e0b80e3a3b4b'} Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:14:23.110523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.111817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.113104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Returning 404 to user: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:14:23.113104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-350a77f0-03d3-4d9c-8197-c349bd392c2c tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 404 len: 111 microversion: 2.1 time: 0.033930 Jun 02 10:14:23.113104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 82/179] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:14:23 2022] DELETE /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:14:23.118023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:23.118640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] [instance: 2fc80296-c07d-44ee-af27-e0b80e3a3b4b] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:23.125432 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.125882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.126681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.127148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.141202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] HTTP exception thrown: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Request method failure captured: Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b HTTP/1.1 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI0qCHkr1IEeEruiQcT7MCbeZEACIUceOUegt4wXRiErMDkJUTIPN2VafINVStwpkkpvonjJhu2i8TUJgkXrU5m_7A_jBpsOx-TzNcjgKCue20zHj_qA_ZgmYroAzFehW-5PIgHQJr9Ug5FVfClFCkt9aajplTivFBthulX0ZqmNmHM Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:14:23.142821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0025aa9f920f45729d8516c9e315e448"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0025aa9f920f45729d8516c9e315e448"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 0025aa9f920f45729d8516c9e315e448 Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-DeleteServersTestJSON-276433408 Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: aea254e4bdc142b9ae1767335fd84d61 Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-DeleteServersTestJSON-276433408-project Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.144339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '2fc80296-c07d-44ee-af27-e0b80e3a3b4b'} Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:14:23.145232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. Jun 02 10:14:23.146489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:14:23.151298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] Returning 404 to user: Instance 2fc80296-c07d-44ee-af27-e0b80e3a3b4b could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:14:23.151298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6965f622-42fd-4a48-95db-64a2b67eb324 tempest-DeleteServersTestJSON-276433408 tempest-DeleteServersTestJSON-276433408-project] 10.222.0.13 "GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b" status: 404 len: 111 microversion: 2.1 time: 0.030014 Jun 02 10:14:23.151298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 98/180] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:23 2022] GET /compute/v2.1/servers/2fc80296-c07d-44ee-af27-e0b80e3a3b4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:14:23.455882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:23.456493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:23.464648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.465211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.466171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:23.466707 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:23.623054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:23.631581 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ac0173a6-37bb-4dbf-966a-0e83bb8bda9c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.179760 Jun 02 10:14:23.632737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 83/181] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:23 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:24.649349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:24.650571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:24.656875 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:24.657327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:24.658146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:24.658644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:24.831647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:24.839811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-65a27665-418e-43aa-bc7b-7cb296dc2398 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.194752 Jun 02 10:14:24.842171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 99/182] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:24 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:25.863758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:25.864458 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:25.870842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:25.873373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:25.873373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:25.873373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:26.019501 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:26.027610 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7d38330e-b90b-4c07-a241-f7820343621d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.167742 Jun 02 10:14:26.028177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 84/183] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:25 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:27.047222 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:27.048482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:27.057792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:27.058505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:27.060002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:27.060654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:27.257354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:27.265989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-08e8a360-59e9-4a03-a241-39748fe36d52 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.225683 Jun 02 10:14:27.275299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 100/184] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:27 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:28.285619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:28.286480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:28.302009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:28.302761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:28.304504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:28.305138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:28.483392 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:28.491221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c2fb8b96-8546-4346-81ff-cfcda8ed8bc2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.211134 Jun 02 10:14:28.491787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 85/185] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:28 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:29.509166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:29.509166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:29.510749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=56 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:29.516182 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:29.516639 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:29.517416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:29.517852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:29.522226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:29.727334 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:29.735787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-54d32333-93f3-4954-ad75-e964cd827a44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.231204 Jun 02 10:14:29.741176 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 101/186] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:29 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:30.759287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:30.759976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:30.782846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:30.782846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:30.782846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:30.782846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:31.097084 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:31.105850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4eb71538-a5d5-4f44-8654-c49c89ecc550 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.352944 Jun 02 10:14:31.106429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 86/187] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:30 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:32.122650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:32.123244 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:32.134303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:32.134762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:32.135605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:32.137957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:32.383168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:32.391141 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dfce9f1f-22ff-408c-bc92-0df5ae5aa353 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.273089 Jun 02 10:14:32.391827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 102/188] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:32 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:33.430320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:33.431019 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:33.453455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:33.453918 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:33.456529 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:33.461310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:33.699991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:33.715814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-91884b8e-d9dd-4336-bcba-7abada1a898a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.300608 Jun 02 10:14:33.725756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 87/189] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:33 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:34.470306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-78c4389e-4ea9-46a0-9c63-5efaf35b8eab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: .version_select at 0x7f49df1ad3a0>, body: {"keypair": {"name": "tempest-keypair-1054603883", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/SHN2nf6KBMQ7Nt4T/iPOXIo85iRvJEo+2xvuoT0lz4UZB8GWFdwyc0zwRZJVwuZZuoHCD+EZvxVPQU1W/vztI0taJJxHrBKDFd64zZyQrFoO9AJ+FRzVvoJBDWYIDkQ=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:34.490866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-78c4389e-4ea9-46a0-9c63-5efaf35b8eab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for project a083c564db474e80af22b7c21af82775. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:14:34.497192 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-78c4389e-4ea9-46a0-9c63-5efaf35b8eab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for user 5a6e44ab0c394541a7d7b290928ea6f8 and project a083c564db474e80af22b7c21af82775. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:14:34.614192 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-78c4389e-4ea9-46a0-9c63-5efaf35b8eab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.515593 Jun 02 10:14:34.620467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 103/190] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 2 10:14:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 517 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 10:14:34.735925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:34.738012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:34.744007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:34.745359 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:34.746139 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:34.746579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:34.964448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:34.972474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8c899588-cfe7-4907-a147-3056800c5928 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.242042 Jun 02 10:14:34.974759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 88/191] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:34 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:35.992221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:35.992840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:36.000272 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:36.000719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:36.001484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:36.001932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:36.185099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:36.192724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5ee7eab4-bd24-4a15-988a-5062163141a6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.204288 Jun 02 10:14:36.204690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 104/192] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:35 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:37.209827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:37.210440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:37.220992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:37.223143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:37.229544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:37.229544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:37.474547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:37.487227 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-66d43f6e-6b2a-4208-81c4-ded66524c98f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.277483 Jun 02 10:14:37.487227 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 89/193] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:37 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:37.838241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2040499922", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "446b9881-f742-4d54-8f0d-e0c8e564e2d9"}], "security_groups": [{"name": "tempest-securitygroup--2102645740"}], "key_name": "tempest-keypair-1054603883", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:37.958186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] validate_networks() for [('446b9881-f742-4d54-8f0d-e0c8e564e2d9', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:14:38.387295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:14:38.387720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:14:38.388199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:14:38.388613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:14:38.389025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:14:38.399051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:38.399546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:38.400882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:38.401702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:38.420257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for project a083c564db474e80af22b7c21af82775. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:14:38.424775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for user 5a6e44ab0c394541a7d7b290928ea6f8 and project a083c564db474e80af22b7c21af82775. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:14:38.438467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:14:38.440803 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:14:38.499680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:38.500315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:38.502632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:38.507478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:38.507932 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:38.508704 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:38.509141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:38.582813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-503c96b6-3d21-429c-89ba-707e4fe25328 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.748792 Jun 02 10:14:38.588676 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 105/194] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 2 10:14:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 10:14:38.594105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:38.594836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:38.659931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:38.664926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:38.673443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:38.675339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:38.676634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-554db418-d5a9-4379-a84a-51f97d3460a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1282 microversion: 2.20 time: 0.086372 Jun 02 10:14:38.676793 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7013d893-021b-4d07-98f1-d101a12bcae0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.181217 Jun 02 10:14:38.677376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 106/196] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:38 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:14:38.677509 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 90/196] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:38 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:39.693703 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:39.694314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:39.694532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:39.695158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:39.701330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:39.701456 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:39.701780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:39.701877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:39.702542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:39.702646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:39.702980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:39.703077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:39.773036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:39.781654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:39.783193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:39.784568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1e835e6b-f7d6-42be-b49d-ab9d34bdf557 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1286 microversion: 2.20 time: 0.094012 Jun 02 10:14:39.785365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 107/197] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:39 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:14:39.839946 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:39.847512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4a93ae8a-77ba-44a6-9c1e-54117d7fb258 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.157698 Jun 02 10:14:39.848091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 91/198] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:39 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:40.802164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:40.802779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:40.808984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:40.809482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:40.810274 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:40.810703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:40.864532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:40.865149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:40.872082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:40.872512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:40.873297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:40.873792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:40.874250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:40.882775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:40.884334 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:40.885945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c0254e98-48d2-40ed-9bd8-a7593dc3fec1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1286 microversion: 2.20 time: 0.087741 Jun 02 10:14:40.886497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 108/199] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:40 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:41.006728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:41.014983 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a0a7805a-9971-4717-8a1f-2b369be4fd23 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.154745 Jun 02 10:14:41.015584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 92/200] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:40 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:41.905760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:41.906371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:41.912370 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:41.912820 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:41.913577 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:41.914013 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:41.974638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:41.983019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:41.984573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:41.985671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-85ed7e7e-9566-4290-9ea5-ab6f5ef42148 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1334 microversion: 2.20 time: 0.086064 Jun 02 10:14:41.986228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 109/201] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:41 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:42.031271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:42.031876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:42.038287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:42.038730 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:42.039511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:42.039944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:42.173666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:42.181090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9888a2b7-60fc-4cfb-94ac-f27c3b8dbf0b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.153679 Jun 02 10:14:42.181670 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 93/202] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:42 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:43.004070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:43.004800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:43.010909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:43.011423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:43.012181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:43.012615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:43.076057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:43.084159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:43.085666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:43.086765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0417efba-6a3d-4bca-806c-ac7f292e7f6b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1334 microversion: 2.20 time: 0.086835 Jun 02 10:14:43.087523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 110/203] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:42 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:43.197682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:43.198302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:43.205451 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:43.205907 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:43.206683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:43.207635 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:43.346254 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:43.353799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-eb9d8cfb-cd52-40b2-bc18-d75ae2e2a9aa tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.160057 Jun 02 10:14:43.354357 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 94/204] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:43 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:44.107068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:44.107981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:44.114905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:44.116265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:44.117103 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:44.117791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:44.198107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:44.206621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:44.208147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:44.212527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c97ab79a-45ad-41e5-afb4-554eb0d19e54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1342 microversion: 2.20 time: 0.108089 Jun 02 10:14:44.212527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 111/205] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:44 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1342 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:44.372302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:44.372916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:44.379436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:44.379892 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:44.380670 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:44.381105 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:44.400756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:44.524736 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:44.532158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-75ad2e0c-c236-493d-82a2-b5889b8c5f4c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1521 microversion: 2.1 time: 0.164663 Jun 02 10:14:44.532725 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 95/206] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:44 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:45.228510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:45.229132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:45.236198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.236649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.239624 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.239624 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.408237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:45.418954 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:45.420505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:45.421656 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f24280ab-4487-42c5-93bb-a8e454131a72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.197934 Jun 02 10:14:45.422344 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 112/207] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:45 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:45.549382 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:45.550686 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:45.557993 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.558447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.559275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.559710 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.722180 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:45.729953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7e1a83ad-7f25-499f-992a-cadda47b521a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1501 microversion: 2.1 time: 0.184400 Jun 02 10:14:45.733150 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 96/208] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:45 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:45.748862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:45.749530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:45.755913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.756368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.757146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:45.757589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:45.897510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:45.905838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-981f6919-6bb8-4a75-8e84-e4b294becf30 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1515 microversion: 2.1 time: 0.161094 Jun 02 10:14:45.906405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 113/209] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:45 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:46.441219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:46.441975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:46.448177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:46.448627 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:46.449395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:46.450475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:46.635277 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:46.646322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:46.647902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:46.649077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-767138a1-e3e3-4bcb-891b-ed16291cd595 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.212147 Jun 02 10:14:46.649609 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 97/210] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:46 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:47.671546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:47.672145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:47.678570 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:47.679019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:47.679804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:47.680301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:47.828213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:47.837026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:47.838626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:47.839984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a777a0b2-3756-45cc-9976-36490465628d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.172392 Jun 02 10:14:47.840977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 114/211] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:47 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:48.859697 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:48.860454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:48.868184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:48.869033 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:48.870827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:48.872170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:49.111558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:49.124799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:49.126782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:49.128195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cf560581-03a2-4371-92e2-352a513ec2f5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.273696 Jun 02 10:14:49.129100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 98/212] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:48 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:50.145839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:50.146455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:50.152228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:50.154914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=12 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:50.154914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:50.155137 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:50.155793 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:50.156234 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:50.311304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:50.320333 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:50.321897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:50.323230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8abee3e8-e1f1-4e00-b64e-ef39c2b30a1a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.181257 Jun 02 10:14:50.323991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 115/213] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:50 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:51.344296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:51.344944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:51.364070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:51.364894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:51.366268 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:51.367448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:51.621643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:51.640365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:51.650697 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:51.654322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e0c176f4-0710-4d1e-9e7d-64cd403bb15d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.316038 Jun 02 10:14:51.654974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 99/214] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:51 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:51.956450 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:51.957530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:51.973053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-cabe3594-97fe-4cba-ac2a-033f42f935d9 req-29780b24-4482-4657-9ac7-c7fb374d3307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:14:51.983644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:51.984901 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:51.986042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:51.986423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-cabe3594-97fe-4cba-ac2a-033f42f935d9 req-29780b24-4482-4657-9ac7-c7fb374d3307 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:51.986790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:51.990339 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-cabe3594-97fe-4cba-ac2a-033f42f935d9 req-29780b24-4482-4657-9ac7-c7fb374d3307 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:52.008034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-cabe3594-97fe-4cba-ac2a-033f42f935d9 req-29780b24-4482-4657-9ac7-c7fb374d3307 service nova] Creating event network-changed:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:14:52.014172 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-cabe3594-97fe-4cba-ac2a-033f42f935d9 req-29780b24-4482-4657-9ac7-c7fb374d3307 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045019 Jun 02 10:14:52.014872 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 100/215] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:14:52.019519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'flavor' on Instance uuid cd186230-f6d5-41ad-abf4-ff9671465a29 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:14:52.390331 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5a29e473-3e32-4c61-bec6-9dbf433a6321 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/action" status: 200 len: 32 microversion: 2.1 time: 0.438791 Jun 02 10:14:52.391325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 116/216] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:14:51 2022] POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:14:52.402131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:52.404969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:52.414816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:52.415810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:52.416864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:52.417460 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:52.612181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:52.621996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-548abc1b-0c4f-4240-8122-cb2e9a4b9f1a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.225619 Jun 02 10:14:52.622575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 101/217] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:52 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:52.676518 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:52.677228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:52.684464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:52.684919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:52.694979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:52.694979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:53.046402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:53.059991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:53.062149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:53.063984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a99c11b9-b0d5-4121-a79c-64226f842d7d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.392210 Jun 02 10:14:53.065277 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 117/218] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:52 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:53.638685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:53.639382 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:53.645921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:53.653123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:53.653123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:53.653123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:53.813500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:53.821600 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ee0e4a67-39a5-4c03-be10-85d8a4e4ef94 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.186647 Jun 02 10:14:53.822186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 102/219] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:53 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:54.082062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:54.083550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:54.090422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:54.091188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:54.092186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:54.092841 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:54.130658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:54.336724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:54.346831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:54.348775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:54.357016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-edbb5e92-6fb1-46e4-84a1-61c8ff24554b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.271922 Jun 02 10:14:54.357016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 118/220] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:54 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:14:54.838389 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:54.839187 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:54.846585 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:54.847182 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:54.848039 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:54.848552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:55.066124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:55.085911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9acc1f33-0d7d-4fa3-bbce-eb83497cdd77 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.251710 Jun 02 10:14:55.109993 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 103/221] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:54 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:55.381475 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:55.384705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:55.393916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:55.394557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:55.395410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:55.396682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:55.595387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:55.607149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:55.609162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:55.610694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-577846fc-d940-425c-bda7-1d8cccfcacc7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.239731 Jun 02 10:14:55.625986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 119/222] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:55 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:56.109725 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:56.120514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:56.120514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:56.120514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:56.120514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:56.121538 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:56.561802 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:56.570397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-96cf24ff-f014-40d0-ab49-916d02025002 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.464904 Jun 02 10:14:56.572723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 104/223] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:56 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:56.629323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:56.630614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:56.637631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:56.638338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:56.639468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:56.640082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:56.884440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:56.897687 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:56.900101 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:56.902014 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-acb9ca84-a50f-4685-9d42-a127db69c524 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.276780 Jun 02 10:14:56.916841 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 120/224] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:56 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:14:57.591496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:57.592709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:57.599851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:57.600525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:57.601482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:57.601920 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:57.756235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:57.765635 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d1669dd8-4bc0-4a3c-8a28-ab6eb6e41653 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.180371 Jun 02 10:14:57.766471 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 105/225] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:57 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:14:57.921257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:57.922390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:57.931239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:57.931866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:57.932779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:57.933354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:58.393302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:58.401605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:58.403228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:58.404360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-612207af-51b0-4be8-82d8-07385118d39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.487170 Jun 02 10:14:58.404928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 121/226] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:57 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:58.783009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:58.785224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:58.791890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:58.794416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:58.794416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:58.794416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:58.946849 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:58.955151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ad868183-92a5-4a46-b53b-710fcd80027b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.176728 Jun 02 10:14:58.957629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 106/227] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:58 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:14:59.422262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:59.422873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:59.429460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:59.429914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:59.431539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:59.432355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:59.582587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:59.593806 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:59.595869 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:14:59.597228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1031fe3b-2c68-4dd7-9dc2-4301e67e339d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.179451 Jun 02 10:14:59.597791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 122/228] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:14:59 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:14:59.976291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:14:59.977646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:14:59.984933 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:59.985472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:14:59.986321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:14:59.986856 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:00.220226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:00.235331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b7173b43-de03-42ff-b171-e6782c259a59 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.265463 Jun 02 10:15:00.278495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 107/229] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:14:59 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:00.615072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:00.615801 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:00.622326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:00.622847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:00.623658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:00.624095 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:00.810524 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:00.826097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:00.828543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:00.830094 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-19c35919-7ac1-48cc-8190-1590e067bd70 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.218951 Jun 02 10:15:00.831332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 123/230] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:00 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:01.290796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:01.291479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:01.314633 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:01.315119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:01.315920 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:01.316357 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:01.503113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:01.520645 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b9804a28-e9ba-4f63-906f-b6e031d73aa4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.233674 Jun 02 10:15:01.522164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 108/231] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:01 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:01.848733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:01.850175 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:01.857861 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:01.858669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:01.859730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:01.860385 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:02.034375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:02.044772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:02.047003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:02.048420 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e0986963-9d6e-43b3-8be9-2b1a9fcf4f09 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.203825 Jun 02 10:15:02.049462 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 124/232] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:01 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:02.539721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:02.540428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:02.573359 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:02.574701 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:02.575838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:02.578473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:02.804367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:02.823135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0a4a7d76-53a8-43e2-8b7f-0d193f6cd88c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.289097 Jun 02 10:15:02.838083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 109/233] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:02 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:03.066840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:03.068151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:03.077583 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:03.086255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:03.086979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:03.088964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:03.090381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:03.425635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:03.437596 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:03.443916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:03.445343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b07ea9a5-fade-422d-bc47-5718211749c6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.383337 Jun 02 10:15:03.447541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 125/234] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:03 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:03.842000 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:03.861740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:03.889107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:03.897323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:03.898073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:03.898564 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:04.041295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-12d15247-15b6-494a-a8af-2e3d8627ab66 req-2c01fccd-7798-4339-a564-d317d032a9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "name": "network-vif-plugged", "status": "completed", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:04.060100 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-12d15247-15b6-494a-a8af-2e3d8627ab66 req-2c01fccd-7798-4339-a564-d317d032a9de service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:04.062151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-12d15247-15b6-494a-a8af-2e3d8627ab66 req-2c01fccd-7798-4339-a564-d317d032a9de service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:04.086010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-12d15247-15b6-494a-a8af-2e3d8627ab66 req-2c01fccd-7798-4339-a564-d317d032a9de service nova] Creating event network-vif-plugged:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:15:04.096639 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-12d15247-15b6-494a-a8af-2e3d8627ab66 req-2c01fccd-7798-4339-a564-d317d032a9de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061992 Jun 02 10:15:04.101605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 126/235] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:15:04.127122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:04.136036 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-30f1a999-0c87-4b6e-87a6-0e30a7762838 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.299042 Jun 02 10:15:04.137408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 110/236] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:03 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:04.471962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:04.472966 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:04.479685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:04.481794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:04.481794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:04.481794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:04.716584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:04.724848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:04.726354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:04.727516 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a14476a8-ea51-45bb-a0f4-a5ab34a16607 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.261756 Jun 02 10:15:04.728075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 127/237] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:04 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:05.153471 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:05.154835 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:05.161716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:05.164616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:05.164616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:05.164616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:05.390956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:05.399883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-da33152d-ac4f-4efe-947e-97fe518a0f0f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.250895 Jun 02 10:15:05.415805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 111/238] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:05 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:05.748931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:05.756310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:05.763589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:05.764243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:05.767856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:05.768607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:05.927002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:05.936737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:05.938535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:05.939669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b6d32dbd-f24c-4db5-869a-b7730eec901d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.197459 Jun 02 10:15:05.940368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 128/239] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:05 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:06.422408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:06.423980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:06.429937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:06.430679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:06.431661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:06.432119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:06.613940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:06.617687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:06.625933 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6474365c-9fba-4e4a-a16e-7ebd4a670677 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.208024 Jun 02 10:15:06.626560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 112/240] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:06 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:06.960642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:06.961305 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:06.967998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:06.968455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:06.969227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:06.969668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:07.110403 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:07.118232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:07.120011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:07.121106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9c2abcae-b1d4-463e-bd1c-12152ff0afb5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.164804 Jun 02 10:15:07.121658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 129/241] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:06 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:07.644414 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:07.644959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:07.651894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:07.652355 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:07.653184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:07.653628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:07.813408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:07.822327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9fde3f82-07d3-451e-af6c-94e640d66048 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.182385 Jun 02 10:15:07.822917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 113/242] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:07 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:08.139848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:08.140997 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:08.148004 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:08.152421 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:08.153191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:08.153635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:08.329888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:08.345017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:08.346553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:08.351028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cfd572b7-3ddc-45e7-be55-4b6a6028cde7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.217211 Jun 02 10:15:08.361909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 130/243] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:08 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:08.839671 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:08.840459 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:08.849220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:08.849679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:08.850499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:08.850942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:09.019157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:09.028382 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5fb4b3f8-c600-4ecc-9340-b237992be045 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.192413 Jun 02 10:15:09.029505 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 114/244] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:08 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:09.373269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:09.374463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:09.381838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:09.383808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:09.384882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:09.385464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:09.553934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:09.564136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:09.566096 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:09.567310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-799e4570-c47d-4ba4-be4a-c706bb42bd55 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.201620 Jun 02 10:15:09.567870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 131/245] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:09 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:10.046248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:10.046882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:10.054206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:10.054659 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:10.055481 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:10.055925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:10.204894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:10.212319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d2aea3d1-02f7-4811-af8e-d2260bdab30c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.170537 Jun 02 10:15:10.212881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 115/246] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:10 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:10.586688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:10.587479 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:10.594323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:10.599346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:10.599346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:10.599346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:10.736048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:10.750643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:10.752457 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:10.753756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b320a91e-0e32-4fd4-94ce-847d3330865a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1408 microversion: 2.20 time: 0.172482 Jun 02 10:15:10.754478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 132/247] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:10 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:11.229433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:11.230046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:11.232365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=52 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:11.237073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:11.237522 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:11.238284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:11.238722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:11.373847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:11.382034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d60354ac-cccc-4478-affc-42ff659892f6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.156467 Jun 02 10:15:11.386827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 116/248] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:11 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:11.590654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-db40026b-a9e0-4660-9793-f7e9d380303c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'create', calling method: .version_select at 0x7f49de7b7dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1144543174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDxaRxSP8KXz/W2aut3CAJUSxLwrarxIRIdF6Av5HDtbKoVwF+Lf8Qtdm6XrX8QiIOSFGOLSiUJ9WFNQI7Yh5rDKuyFnVweOrss16t6Q2jRjIFK1IvGucuGvi0biGmKQ=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:11.604353 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-db40026b-a9e0-4660-9793-f7e9d380303c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Getting quotas for project 0fe7771afa3e4fb0a3fcfa8f328c1ebb. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:15:11.608734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-db40026b-a9e0-4660-9793-f7e9d380303c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Getting quotas for user f4a690835f9143b096f00fceb47d4a10 and project 0fe7771afa3e4fb0a3fcfa8f328c1ebb. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:15:11.699209 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-db40026b-a9e0-4660-9793-f7e9d380303c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.112286 Jun 02 10:15:11.702441 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 133/249] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:15:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:11.795941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:11.796687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:11.802939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-371899359", "imageRef": "624c8f46-750d-45d2-8362-286de83c0341", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1144543174", "networks": [{"uuid": "386ced09-ce05-4756-a7eb-70ef0e6d22e4"}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:11.806622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:11.807242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:11.808845 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:11.809437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:11.881616 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] validate_networks() for [('386ced09-ce05-4756-a7eb-70ef0e6d22e4', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:15:11.986821 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:12.001230 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:12.001613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:12.002776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-51503413-e608-4d63-b5e3-42ab272251d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1600 microversion: 2.20 time: 0.231509 Jun 02 10:15:12.003368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 117/250] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:15:11 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1600 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:15:12.020865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:12.021580 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:12.028530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.028985 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.029931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.030535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.118476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-32b1ca35-4ff4-4d75-8274-e92c587d9702 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102006 Jun 02 10:15:12.123170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 118/251] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 2 10:15:12 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:15:12.308842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:15:12.309471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:15:12.312771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:15:12.312771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:15:12.312771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:15:12.321117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.321724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.322604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.323133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.343131 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Getting quotas for project 0fe7771afa3e4fb0a3fcfa8f328c1ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:15:12.347384 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Getting quotas for user f4a690835f9143b096f00fceb47d4a10 and project 0fe7771afa3e4fb0a3fcfa8f328c1ebb. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:15:12.360501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:15:12.362785 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='624c8f46-750d-45d2-8362-286de83c0341',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:15:12.400053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:12.400746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:12.407391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.407840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.408627 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:12.409059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:12.497243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cd292498-1642-4544-bb8c-2841bd29620f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698064 Jun 02 10:15:12.498110 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 134/252] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:15:12.507913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-04fa5165-c058-4194-97b7-56135b1039bd tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:12.508511 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-04fa5165-c058-4194-97b7-56135b1039bd tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:12.579962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-04fa5165-c058-4194-97b7-56135b1039bd tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:12.587189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-04fa5165-c058-4194-97b7-56135b1039bd tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1258 microversion: 2.1 time: 0.082955 Jun 02 10:15:12.587764 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 135/253] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:12 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:12.735274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:12.742994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bcd0ebc6-f2ad-4a1a-b92c-bfa11efe1de7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.347095 Jun 02 10:15:12.743784 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 119/254] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:12 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:13.611699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ab23ae77-0395-49f1-8ada-0413eaeccadc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:13.611699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ab23ae77-0395-49f1-8ada-0413eaeccadc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:13.663891 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ab23ae77-0395-49f1-8ada-0413eaeccadc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:13.672728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ab23ae77-0395-49f1-8ada-0413eaeccadc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1258 microversion: 2.1 time: 0.072105 Jun 02 10:15:13.674282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 136/255] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:13 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:13.765568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:13.767455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-6c30b53a-38df-4649-9c23-f246b44c3551 req-3c5d17da-8bc0-4bc3-b574-74c65ab9ee77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:13.767995 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:13.782401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:13.782859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:13.784798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:13.785007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-6c30b53a-38df-4649-9c23-f246b44c3551 req-3c5d17da-8bc0-4bc3-b574-74c65ab9ee77 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:13.785619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-6c30b53a-38df-4649-9c23-f246b44c3551 req-3c5d17da-8bc0-4bc3-b574-74c65ab9ee77 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:13.786245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:13.801560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-6c30b53a-38df-4649-9c23-f246b44c3551 req-3c5d17da-8bc0-4bc3-b574-74c65ab9ee77 service nova] Creating event network-changed:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:15:13.807117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-6c30b53a-38df-4649-9c23-f246b44c3551 req-3c5d17da-8bc0-4bc3-b574-74c65ab9ee77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046545 Jun 02 10:15:13.808282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 137/256] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:13.953149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:13.961328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-33ab8788-6368-4b50-bce6-9ee5735bc22f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.204329 Jun 02 10:15:13.962220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 120/257] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:13 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:14.690745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:14.691387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:14.697670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:14.698116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:14.698874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:14.699338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:14.760126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:14.767522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9d194a79-5661-47d7-8256-6f12d9c3d0be tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1262 microversion: 2.1 time: 0.081036 Jun 02 10:15:14.768097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 138/258] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:14 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:14.981199 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:14.981810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:14.988832 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:14.989288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:14.990095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:14.990533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:15.155325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:15.167698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fcada715-0155-4c86-b97d-9b7e870fc660 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.190776 Jun 02 10:15:15.178214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 121/259] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:14 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:15.784225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:15.784840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:15.790897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:15.791378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:15.792144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:15.792605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:15.856356 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:15.864022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5bfa5785-3398-4f14-b272-8335c53396d1 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1254 microversion: 2.1 time: 0.083600 Jun 02 10:15:15.864621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 139/260] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:15 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:16.193993 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:16.194597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:16.202732 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:16.203205 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:16.203976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:16.204480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:16.339347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:16.347508 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fefa24b0-bf09-4809-9d9d-75aacf59c401 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.157386 Jun 02 10:15:16.348083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 122/261] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:16 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:16.881982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:16.882582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:16.889040 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:16.889484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:16.890242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:16.890668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:16.907399 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:16.955228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:16.962864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4b5a1762-6dcd-4747-be69-725397de7d86 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1310 microversion: 2.1 time: 0.084595 Jun 02 10:15:16.963866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 140/262] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:16 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:17.365243 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:17.365878 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:17.373349 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:17.374741 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:17.374741 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:17.374972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:17.505996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:17.514142 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7c92a7e8-36ee-4475-9977-a425dea6fd7e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.152866 Jun 02 10:15:17.514747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 123/263] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:17 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:17.979524 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:17.980219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:17.986589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:17.987040 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:17.987831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:17.988356 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:18.049018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:18.056352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6a4412be-9054-40d9-9d0d-ab32f6fa6dda tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1310 microversion: 2.1 time: 0.080632 Jun 02 10:15:18.056938 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 141/264] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:17 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:18.535198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:18.535866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:18.542283 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:18.542951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:18.544484 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:18.547611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:18.675720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:18.683533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f857552c-af75-4c91-966a-6bc68fb777a5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.152099 Jun 02 10:15:18.684128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 124/265] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:18 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:19.073844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:19.074458 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:19.081150 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:19.081628 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:19.082359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:19.082794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:19.143204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:19.150606 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f69ff144-619d-4c87-b98d-679a484b3e73 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1310 microversion: 2.1 time: 0.080842 Jun 02 10:15:19.151307 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 142/266] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:19 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1310 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:19.699966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:19.700613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:19.707107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:19.707590 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:19.708365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:19.708866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:19.839251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:19.847710 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f276d4a5-12b1-4ae5-9976-f714a58d1a81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.151520 Jun 02 10:15:19.848276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 125/267] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:19 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:20.170480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:20.171343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:20.177956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:20.178612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:20.179465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:20.179906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:20.249666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:20.258443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1c4877f2-80d8-4643-9eb8-36e4973d9cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1310 microversion: 2.1 time: 0.093992 Jun 02 10:15:20.259031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 143/268] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:20 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:20.864744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:20.865407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:20.874213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:20.874669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:20.875473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:20.875908 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.029563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:21.036999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-87954f8b-5e71-454b-bb54-fb757665c772 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1501 microversion: 2.1 time: 0.176064 Jun 02 10:15:21.037570 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 126/269] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:20 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:21.056341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1e9820f-ba20-45b8-bcff-7ce1f771670a"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:21.057464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:21.065264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.065720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.066543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.066994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.093003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] HTTP exception thrown: Cannot 'attach_volume' instance cd186230-f6d5-41ad-abf4-ff9671465a29 while it is in vm_state rescued Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Request method failure captured: Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/os-volume_attachments HTTP/1.1 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 74 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI0yUcoLXNG5MwP88pRdB-RsNCsaqrBtpgJ4EDDQKANbI2D6qJtW3oC0t8EUTCqzNTTZUqRm81WxOLdkAonuHyrgy7MdSLj9QeWh8ZqGHfZYAvPvdJ6WbD4dUzMymhSkYDo4-MI99qAj50EcP-VBKb1z1Wy6iT-HvRwcM0H48PLE5WQ Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:15:21.095253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: a696d00855ef439c9d80b6bec5312f20 Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {"volumeAttachment": {"volumeId": "b1e9820f-ba20-45b8-bcff-7ce1f771670a"}} Jun 02 10:15:21.096780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Cannot 'attach_volume' instance cd186230-f6d5-41ad-abf4-ff9671465a29 while it is in vm_state rescued Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'server_id': 'cd186230-f6d5-41ad-abf4-ff9671465a29', 'body': {'volumeAttachment': {'volumeId': 'b1e9820f-ba20-45b8-bcff-7ce1f771670a'}}} Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:15:21.097630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance cd186230-f6d5-41ad-abf4-ff9671465a29 while it is in vm_state rescued Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:15:21.098779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:15:21.100037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:15:21.100037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:15:21.100037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance cd186230-f6d5-41ad-abf4-ff9671465a29 while it is in vm_state rescued Jun 02 10:15:21.100037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:15:21.101199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Returning 409 to user: Cannot 'attach_volume' instance cd186230-f6d5-41ad-abf4-ff9671465a29 while it is in vm_state rescued {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:15:21.102128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9b223665-e571-4b1b-a475-2dc412d8f5a2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052133 Jun 02 10:15:21.102697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 144/270] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:15:21 2022] POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 10:15:21.113198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:21.114042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:21.120379 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.122096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.122349 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.122889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.275006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:21.275658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:21.282402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.282770 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.283738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.284173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.397164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-852fd531-a251-4819-b2f7-0faae038b866 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/action" status: 202 len: 0 microversion: 2.1 time: 0.286915 Jun 02 10:15:21.398166 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 127/271] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:15:21 2022] POST /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:15:21.418078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:21.431492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-292fc897-e0ed-4b13-82ff-6f298e858bd2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1316 microversion: 2.1 time: 0.160291 Jun 02 10:15:21.432262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 145/272] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:21 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:21.437324 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:21.439865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:21.452961 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.453541 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.454455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:21.459457 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:21.641594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:21.645244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:21.650135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e716914f-ecb0-441c-9346-fa37e230764a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.239688 Jun 02 10:15:21.660002 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 128/273] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:21 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:22.449874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:22.450716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:22.453608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:22.458766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:22.459510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:22.460649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:22.461464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:22.660305 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:22.675957 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:22.675957 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:22.676494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cf1bef01-4eb4-41bc-9aca-fb5c547d1471 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.222974 Jun 02 10:15:22.676574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:22.676574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:22.676574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:22.677071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:22.679277 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 146/274] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:22 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:22.886586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:22.895574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5e6393d7-8373-432d-b14c-41218f5e0657 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.232116 Jun 02 10:15:22.898787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 129/275] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:22 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:23.044691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-94a187f9-b44f-4acc-8530-1cc594386581 req-d979ee09-ed64-4397-accc-63839ef88279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:23.053424 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-94a187f9-b44f-4acc-8530-1cc594386581 req-d979ee09-ed64-4397-accc-63839ef88279 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:23.054314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-94a187f9-b44f-4acc-8530-1cc594386581 req-d979ee09-ed64-4397-accc-63839ef88279 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:23.082289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-94a187f9-b44f-4acc-8530-1cc594386581 req-d979ee09-ed64-4397-accc-63839ef88279 service nova] Creating event network-changed:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:15:23.087654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-94a187f9-b44f-4acc-8530-1cc594386581 req-d979ee09-ed64-4397-accc-63839ef88279 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048020 Jun 02 10:15:23.092951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 147/276] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:23.686440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:23.687831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:23.695247 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:23.696118 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:23.697253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:23.698312 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:23.881746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:23.890071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-357f3bf4-f7f4-45d9-b994-3ab22493e135 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.207952 Jun 02 10:15:23.899958 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 130/277] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:23 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:23.924975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=14 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:23.929600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:23.930325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:23.937387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:23.937844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:23.938620 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:23.939059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:24.101807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:24.119211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-93ada58c-b067-4fe0-892a-4a56de394dd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.194836 Jun 02 10:15:24.119893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 148/278] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:23 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:24.910994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:24.914488 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:24.925894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:24.927334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:24.928428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:24.929025 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:25.110975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:25.128218 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-61153c34-1d0c-46ae-9d1b-353a259d690a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.223862 Jun 02 10:15:25.130173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 131/279] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:24 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:25.139556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:25.140439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:25.147230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:25.148398 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:25.149387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:25.149957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:25.322839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:25.331247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-59b5dee6-3056-4fbc-b387-91d5d35fe131 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.197387 Jun 02 10:15:25.331823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 149/280] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:25 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:26.146001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:26.146607 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:26.153720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:26.154160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:26.156440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:26.156440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:26.309325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:26.318100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2c9ae48e-6601-4903-9b2b-6c0112235494 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.176012 Jun 02 10:15:26.319376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 132/281] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:26 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:26.348681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:26.349937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:26.356879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:26.358760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:26.358760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:26.358760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:26.522208 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:26.531053 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-36cc6a04-ac43-42b6-ae60-2452086e5bf2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.186587 Jun 02 10:15:26.531824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 150/282] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:26 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:27.335636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:27.336225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:27.342644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:27.343107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:27.343883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:27.344315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:27.477792 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:27.486279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-461a0658-743f-4ec0-8a91-cb9a47975242 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.154523 Jun 02 10:15:27.486831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 133/283] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:27 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:27.549446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:27.550050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:27.555901 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:27.556350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:27.557090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:27.557513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:27.688429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:27.696511 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6f6467c5-b4b0-4633-b2a2-d7e4428553ce tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.150909 Jun 02 10:15:27.697083 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 151/284] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:27 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:28.503415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:28.504023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:28.517269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:28.517588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:28.518365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:28.518799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:28.682530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:28.693309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e9fee84c-a02f-4d26-96d3-be47253e3edc tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.193620 Jun 02 10:15:28.694820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 134/285] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:28 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:28.712733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:28.713345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:28.719540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:28.719991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:28.720833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:28.721177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:28.913500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:28.930287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c1a5b6e3-f050-4aa7-b860-f103676cfb91 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.215361 Jun 02 10:15:28.931036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 152/286] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:28 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:29.709666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:29.710278 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:29.717306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:29.717741 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:29.718505 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:29.718943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:29.848516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:29.856446 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a641b623-1419-4e86-9957-308c385ea7a8 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.149986 Jun 02 10:15:29.857009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 135/287] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:29 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:29.947295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:29.947907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:29.954357 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:29.954815 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:29.955619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:29.956058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:30.165049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:30.175233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e7f27a4d-9169-4f80-a236-d0fd11469932 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.231762 Jun 02 10:15:30.175819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 153/288] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:29 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:30.874113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:30.875471 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:30.882636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:30.883111 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:30.884085 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:30.884534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:31.018157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:31.025485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-922dfa6c-763b-4800-a31b-5a1c2e64f155 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.155975 Jun 02 10:15:31.026042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 136/289] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:30 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:31.202560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:31.202560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:31.202560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:31.202560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:31.204227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:31.204227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:31.394626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:31.394626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-73c4b571-90d1-4001-8f4f-5b54ec0568e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.152875 Jun 02 10:15:31.394626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 154/290] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:31 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:32.042518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:32.043179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:32.049639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:32.050088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:32.050843 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:32.051310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:32.179154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:32.186385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d6714f5e-d921-48f5-8451-8ea39627aed4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.147910 Jun 02 10:15:32.187508 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 137/291] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:32 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:32.409947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:32.411405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:32.417631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:32.418086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:32.418863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:32.419326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:32.552415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:32.559803 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f764a37e-b1fc-4454-9f7a-d40649364771 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.153772 Jun 02 10:15:32.560369 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 155/292] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:32 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:33.210647 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:33.211593 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:33.217904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:33.224722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:33.224722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:33.224722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:33.372808 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:33.380569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a68eb0e2-b9be-4fee-8a5e-c6b40fb682f4 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.179693 Jun 02 10:15:33.381126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 138/293] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:33 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:33.577112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:33.578382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:33.580570 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:33.586837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:33.587509 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:33.588916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:33.593907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:33.740372 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:33.750353 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-aa78c8a0-67d0-4efe-a297-3761645e8c79 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.177526 Jun 02 10:15:33.799248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 156/294] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:33 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:34.398344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:34.399039 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:34.407465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:34.407921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:34.408847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:34.409294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:34.555832 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:34.570178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8d7bd644-441b-4825-9ad3-958f1d9263b2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.171674 Jun 02 10:15:34.576174 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 139/295] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:34 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:34.815512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:34.817225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:34.826475 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:34.828177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:34.829836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:34.830532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:35.017798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:35.022238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:35.026843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a1398c0b-f04b-4222-8230-d58b429f5fe4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.216085 Jun 02 10:15:35.026843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 157/296] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:34 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:35.590992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:35.591575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:35.598062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:35.598510 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:35.599318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:35.599754 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:35.732224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:35.741157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-04292fe1-bd6e-4108-8ccb-81169be375b7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.154090 Jun 02 10:15:35.741827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 140/297] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:35 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:36.043191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:36.043983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:36.050634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:36.051188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:36.051860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:36.052295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:36.181294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:36.188906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-41f167b0-e525-497b-8776-07e16738a7e8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.149886 Jun 02 10:15:36.189410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 158/298] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:36 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:36.763595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:36.763595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:36.768732 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:36.772716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:36.772716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:36.772716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:36.914222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:36.922968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1e2a3a74-98e0-4555-bf49-919fc357c408 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.169093 Jun 02 10:15:36.923669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 141/299] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:36 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:37.205763 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:37.206376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:37.212623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:37.213093 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:37.213933 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:37.214432 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:37.415858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:37.425350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d1db4166-9b06-48af-b49b-57d1f594318b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.223371 Jun 02 10:15:37.425868 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 159/300] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:37 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:37.940634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:37.941294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:37.949489 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:37.949489 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:37.949489 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:37.949929 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:38.105421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:38.113692 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6142e5ab-3eeb-4dfe-a6bd-0ece921d6323 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.177438 Jun 02 10:15:38.115461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 142/301] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:37 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:38.442413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:38.443023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:38.449273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:38.449728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:38.450491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:38.450930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:38.577670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:38.585264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d5f4c81b-2a95-4fdc-9f39-0fb30bb70a88 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.146815 Jun 02 10:15:38.585835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 160/302] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:38 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:39.130859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:39.131495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:39.138096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:39.138552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:39.139353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:39.140306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:39.288775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:39.296429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-71cabf42-f560-4850-85e2-273f6ce60015 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.169456 Jun 02 10:15:39.297001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 143/303] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:39 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:39.602047 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:39.602646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:39.608694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:39.609139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:39.610169 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:39.610366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:39.736415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:39.744204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ff31d163-8cb3-454e-9ffa-71ab91909595 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.145956 Jun 02 10:15:39.747832 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 161/304] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:39 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:40.313847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:40.314709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:40.322145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:40.324584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:40.324584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:40.324584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:40.461232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:40.471573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2bf48a7c-dc6a-4cfd-ae4e-4c254ee5689e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.161692 Jun 02 10:15:40.476699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 144/305] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:40 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:40.761527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:40.762015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:40.768718 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:40.769191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:40.769960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:40.770399 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:40.903545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:40.911906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4da50117-7059-4652-a5ec-72c70cb49200 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.154341 Jun 02 10:15:40.912816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 162/306] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:40 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:41.491328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:41.491938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:41.494460 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=58 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:41.499763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:41.500211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:41.500985 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:41.501428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:41.520699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:41.665141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:41.689977 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6dd08f3c-19d5-42a0-82da-8650258d7cf2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.202489 Jun 02 10:15:41.699445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 145/307] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:41 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:41.929799 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:41.932497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:41.936652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:41.937131 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:41.937885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:41.938327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:42.075783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:42.085092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-07979791-6f3a-446b-86c6-58cc9c0171a1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1509 microversion: 2.1 time: 0.159915 Jun 02 10:15:42.085899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 163/308] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:41 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:42.710962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:42.712081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:42.721478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:42.725051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:42.725051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:42.725051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:42.867280 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:42.878337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-402c1a7a-f53a-4991-bb3d-64039abcc293 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.172284 Jun 02 10:15:42.878910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 146/309] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:42 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:43.102836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:43.103475 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:43.110654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:43.111533 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:43.112378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:43.112826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:43.253560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:43.269480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-45fd1f52-ef61-4c83-a5ae-677322613cee tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1515 microversion: 2.1 time: 0.170342 Jun 02 10:15:43.274899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 164/310] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:43 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:43.896034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:43.897745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:43.906307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:43.907222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:43.907875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:43.908323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:44.095444 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:44.106195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6fe5bced-f344-4977-8f52-4341479ae8ba tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.213962 Jun 02 10:15:44.111789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 147/311] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:43 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:45.129343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:45.131642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:45.138567 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:45.140098 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:45.141188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:45.142104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:45.286594 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:45.294438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-00df8846-1285-4da6-a801-c7e14dff95ce tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.169473 Jun 02 10:15:45.295050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 165/312] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:45 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:45.953168 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-00b0db72-7fd8-4c1f-81b8-acd21f05fc96 req-60639496-8beb-4541-b780-b4a675a42fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "name": "network-vif-plugged", "status": "completed", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:45.962752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-00b0db72-7fd8-4c1f-81b8-acd21f05fc96 req-60639496-8beb-4541-b780-b4a675a42fed service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:45.963233 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-00b0db72-7fd8-4c1f-81b8-acd21f05fc96 req-60639496-8beb-4541-b780-b4a675a42fed service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:45.974917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-00b0db72-7fd8-4c1f-81b8-acd21f05fc96 req-60639496-8beb-4541-b780-b4a675a42fed service nova] Creating event network-vif-plugged:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:15:45.980145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-00b0db72-7fd8-4c1f-81b8-acd21f05fc96 req-60639496-8beb-4541-b780-b4a675a42fed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031188 Jun 02 10:15:45.981007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 148/313] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:46.098288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-54f73055-c66a-43e4-a32e-921b5357709e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: .version_select at 0x7f49de7bf940>, body: {"keypair": {"name": "tempest-keypair-1038190263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ09HLCLPMrU7AuYA4ZYGPh3PaYz/9qNvrIfHQpG9AH6mp7xMt7RvSFDGaNRHnbxaZahtILvX9PRtrH5Hb2B+Wzz4vGTsWSEyqsOgzJLpVNc9ZdinRYHV7YD4EiJDXYjKQ=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:46.114297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-54f73055-c66a-43e4-a32e-921b5357709e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:15:46.118808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-54f73055-c66a-43e4-a32e-921b5357709e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for user a696d00855ef439c9d80b6bec5312f20 and project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:15:46.239339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-54f73055-c66a-43e4-a32e-921b5357709e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146863 Jun 02 10:15:46.241361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 166/314] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:15:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:46.312220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:46.312922 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:46.319186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:46.319639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:46.320438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:46.320878 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:46.500496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:46.508733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0f7d398a-2a76-48b1-b9bb-996746280ba5 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.200654 Jun 02 10:15:46.509311 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 149/315] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:46 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:47.526569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:47.527234 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:47.533352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:47.533800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:47.534585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:47.535020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:47.669341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:47.678273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9ce46c49-af4b-431b-a0b1-263296687f6c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1358 microversion: 2.1 time: 0.156001 Jun 02 10:15:47.678892 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 167/316] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:47 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:48.695539 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:48.696214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:48.703991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:48.704450 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:48.705380 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:48.705742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:48.819451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-440574124", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17d5c6d4-5995-4814-a0c3-133509337a04"}], "security_groups": [{"name": "tempest-securitygroup--1995169522"}], "key_name": "tempest-keypair-1038190263", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:48.866257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:48.874226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-06bb1be6-91a9-4ab3-ba6e-cf4939eabd19 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1547 microversion: 2.1 time: 0.182721 Jun 02 10:15:48.875413 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 150/317] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:48 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:48.897889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:48.898503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:48.904767 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:48.905220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:48.906052 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:48.906665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:48.933132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] validate_networks() for [('17d5c6d4-5995-4814-a0c3-133509337a04', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:15:49.041717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:49.050451 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7478c935-9e26-4943-9a0d-61c064efee30 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1547 microversion: 2.1 time: 0.157068 Jun 02 10:15:49.051028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 151/318] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:48 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:49.068450 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:49.072101 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:49.072877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Searching by: {'deleted': False, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb'} {{(pid=118067) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 02 10:15:49.080546 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.081035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.081863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.082509 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.180129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.multi_cell_list [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118067) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 02 10:15:49.286999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f3ad437e-59c9-4654-8c28-a9a5ad1b835a tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.224070 Jun 02 10:15:49.287828 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 152/319] 10.222.0.13 () {58 vars in 1124 bytes} [Thu Jun 2 10:15:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:49.298423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:49.299166 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:49.306172 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.306621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.307429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.307867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.335610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:15:49.336913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:15:49.337591 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:15:49.338119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:15:49.339145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:15:49.349968 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.350621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.351685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:49.352166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:49.371306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:15:49.375670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Getting quotas for user a696d00855ef439c9d80b6bec5312f20 and project 86951ec86e2046c3bbba0ba1bc6738e2. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:15:49.387967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:15:49.390252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:15:49.450115 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:49.458196 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9970b02d-dd5c-4111-b89d-1ea255e8e95d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1547 microversion: 2.1 time: 0.164027 Jun 02 10:15:49.458691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 153/320] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:49 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:49.554829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ace18104-3bb2-4874-af3e-0ed52865d914 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.739592 Jun 02 10:15:49.567170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 168/321] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:15:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 10:15:49.572365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ebea99be-4f65-4b2f-8235-8a122abef2e6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:49.572979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ebea99be-4f65-4b2f-8235-8a122abef2e6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:49.629146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ebea99be-4f65-4b2f-8235-8a122abef2e6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:49.637476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ebea99be-4f65-4b2f-8235-8a122abef2e6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1245 microversion: 2.1 time: 0.068854 Jun 02 10:15:49.643329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 154/322] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:49 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1245 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:50.654775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:50.655522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:50.662216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:50.662579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:50.663369 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:50.663805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:50.724886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:50.732451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cb431b92-00a8-4123-ac88-15c0a466924f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1249 microversion: 2.1 time: 0.081487 Jun 02 10:15:50.733018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 169/323] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:50 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:51.749420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:51.750072 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:51.756433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:51.756880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:51.757644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:51.758082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:51.821127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:51.829213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fae5a7a1-cf30-47af-8bc9-0f09ec2f517b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1249 microversion: 2.1 time: 0.083611 Jun 02 10:15:51.829771 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 155/324] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:51 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:52.845824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:52.846429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:52.852393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:52.852833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:52.853590 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:52.854022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:52.917405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:52.925461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1af42c7b-832c-4d16-878b-c06ffd353f1c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1249 microversion: 2.1 time: 0.083495 Jun 02 10:15:52.926031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 170/325] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:52 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:53.942189 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:53.942836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:53.949333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:53.949790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:53.950560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:53.951004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:54.019677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:54.027190 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-161c1b6a-47a7-4300-ab74-91f8854cc9bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1241 microversion: 2.1 time: 0.088856 Jun 02 10:15:54.027842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 156/326] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:53 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:55.044258 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:55.045510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:55.051654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:55.052097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:55.052856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:55.053289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:55.114866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:55.122332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5298ade7-41cc-42e6-b0c8-9c1b48ea3d81 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1297 microversion: 2.1 time: 0.082049 Jun 02 10:15:55.122877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 171/327] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:55 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:56.140157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:56.140157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:56.146617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:56.147071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:56.148026 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:56.148466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:56.216104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:56.224345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-94f5da15-436d-4a6c-bb82-79408b903bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1303 microversion: 2.1 time: 0.089706 Jun 02 10:15:56.224944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 157/328] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:56 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:56.734794 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:56.736146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:56.742451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:56.743296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:56.744285 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:56.744791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:57.242096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:57.242707 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:57.249394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:57.249842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:57.250601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:57.251035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:57.394080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:57.406748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cdd03200-5b4b-4ea5-8f1a-ec81b488db10 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.168293 Jun 02 10:15:57.407387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 158/329] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:57 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:15:57.602910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bc8ebfbf-2ce7-496f-b8f7-3275c08b08fa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871849 Jun 02 10:15:57.604256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 172/330] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:15:56 2022] POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:57.790711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-ceafbe4f-fc28-4a58-b2af-61df45d7e707 req-298554d2-b228-41df-a2ed-0be93e1d48fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:15:57.799737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-ceafbe4f-fc28-4a58-b2af-61df45d7e707 req-298554d2-b228-41df-a2ed-0be93e1d48fd service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:57.800458 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-ceafbe4f-fc28-4a58-b2af-61df45d7e707 req-298554d2-b228-41df-a2ed-0be93e1d48fd service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:57.812769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-ceafbe4f-fc28-4a58-b2af-61df45d7e707 req-298554d2-b228-41df-a2ed-0be93e1d48fd service nova] Creating event network-changed:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:15:57.818305 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-ceafbe4f-fc28-4a58-b2af-61df45d7e707 req-298554d2-b228-41df-a2ed-0be93e1d48fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031927 Jun 02 10:15:57.818917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 159/331] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:15:58.425935 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:58.426636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:58.432941 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:58.433386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:58.434144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:58.434581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:58.566500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:58.573902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-180618a8-efec-4742-8298-1352ec35646b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.153361 Jun 02 10:15:58.574516 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 173/332] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:58 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:15:59.588661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:59.592788 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:15:59.594113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:15:59.600195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:59.603412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:59.603412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:15:59.603412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:15:59.633991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:59.737728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:15:59.745385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c252b085-cb39-44e6-bcaf-4b2923b9f8ad tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.158204 Jun 02 10:15:59.745949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 160/333] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:15:59 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:00.761980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:00.762597 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:00.764564 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:00.765894 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=10 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:00.771123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:00.771586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:00.772349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:00.772842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:00.901036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:00.903515 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:00.909874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5ed1efa0-4adb-4a39-bcb8-b14c361e2d64 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.151721 Jun 02 10:16:00.916084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 174/334] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:00 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:01.929887 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:01.930498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:01.937053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:01.937498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:01.938260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:01.938698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:02.064618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:02.071983 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-faf0bc1d-86d7-4d0d-9dc7-3c109831bf3b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.145934 Jun 02 10:16:02.072545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 161/335] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:01 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:03.088557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:03.089201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:03.096731 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:03.097212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:03.097976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:03.098467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:03.312631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:03.320181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fe508d3e-f340-4059-9a16-505fc966d6de tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.235791 Jun 02 10:16:03.320753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 175/336] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:03 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:04.337654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:04.338252 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:04.344814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:04.345255 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:04.346082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:04.346511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:04.527888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:04.535466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2d567ec2-9243-4407-91fe-b9a877ea8fe5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.201687 Jun 02 10:16:04.536038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 162/337] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:04 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:05.552091 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:05.552706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:05.559365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:05.559825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:05.560624 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:05.561067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:05.696366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:05.704323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bb87764d-39e5-4a2d-85c2-b13fc53e995f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.156171 Jun 02 10:16:05.704886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 176/338] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:05 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:06.720551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:06.721195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:06.727743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:06.728202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:06.728953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:06.729391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:06.858316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:06.866367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4763013a-bba9-4e3d-bc48-86e5b2bd8e26 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.149564 Jun 02 10:16:06.866868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 163/339] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:06 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:07.883705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:07.884317 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:07.886649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:07.891983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:07.892435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:07.893240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:07.893678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:08.021196 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:08.028417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a4a4351d-13bb-4222-9375-0229c99b4fa5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.148608 Jun 02 10:16:08.028984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 177/340] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:07 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:09.045011 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:09.045632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:09.052041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:09.052495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:09.053259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:09.053699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:09.057613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:09.180797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:09.188612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-57ae014f-995c-4783-957f-f71d75a9c32b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.147524 Jun 02 10:16:09.189184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 164/341] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:09 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:10.205810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:10.206494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:10.213236 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:10.213686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:10.214477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:10.214914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:10.347809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:10.355183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7d1a4d6e-3d58-4d53-b52e-c9c8898a2da6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.154393 Jun 02 10:16:10.364327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 178/342] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:10 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:11.371675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:11.372289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:11.378881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:11.387757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:11.387757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:11.387757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:11.523138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:11.530992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1845eee8-78cf-4539-a085-9dc63d929bf0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.163974 Jun 02 10:16:11.531613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 165/343] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:11 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:12.548790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:12.550016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:12.556991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:12.557927 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:12.558886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:12.559351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:12.746017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:12.753724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a322df1f-c1f5-4f66-8f7d-b0a19b737deb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.209342 Jun 02 10:16:12.754478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 179/344] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:12 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:13.770863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:13.771514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:13.773990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=44 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:13.778765 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:13.783241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:13.783241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:13.783241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:13.916506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:13.923938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b486db84-eaf9-4c38-bee8-608cc0239711 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.157465 Jun 02 10:16:13.924509 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 166/345] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:13 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:14.942039 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:14.942686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:14.949016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:14.949582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:14.950565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:14.951054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:15.093282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:15.100992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-31e0aed9-cdb2-43a5-aa4a-8638b08f4250 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.164140 Jun 02 10:16:15.101678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 180/346] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:14 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:15.815950 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-af3c10d8-9f09-406b-992c-e3de339d60a2 req-3e933422-bbb6-4380-b59c-b9240229bd80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "name": "network-vif-plugged", "status": "completed", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:15.825049 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-af3c10d8-9f09-406b-992c-e3de339d60a2 req-3e933422-bbb6-4380-b59c-b9240229bd80 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:15.825706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-af3c10d8-9f09-406b-992c-e3de339d60a2 req-3e933422-bbb6-4380-b59c-b9240229bd80 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:15.838166 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-af3c10d8-9f09-406b-992c-e3de339d60a2 req-3e933422-bbb6-4380-b59c-b9240229bd80 service nova] Creating event network-vif-plugged:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:16:15.843906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-af3c10d8-9f09-406b-992c-e3de339d60a2 req-3e933422-bbb6-4380-b59c-b9240229bd80 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 Jun 02 10:16:15.845313 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 167/347] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:16.118572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:16.119411 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:16.126368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:16.126905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:16.127797 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:16.128473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:16.342931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:16.351476 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-041b013c-f325-4b27-b018-44ddbf9086e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.237285 Jun 02 10:16:16.368468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 181/348] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:16 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:17.370331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:17.371294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:17.379633 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:17.384398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:17.384398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:17.384398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:17.620027 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:17.632060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d4873670-fe1f-4bf5-8da4-31dfd934e891 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.262394 Jun 02 10:16:17.632060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 168/349] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:17 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:18.650627 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:18.651724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:18.660126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:18.660837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:18.661927 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:18.662719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:18.827181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:18.837978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3cd0b3d5-dfb4-47b0-af4e-863d5dcbb978 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.195890 Jun 02 10:16:18.839449 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 182/350] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:18 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:19.853463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:19.854081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:19.860798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:19.861249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:19.862194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:19.862632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:19.998949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:20.007201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3386b2cd-b9da-462e-94d8-ffb4be109712 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.157517 Jun 02 10:16:20.007776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 169/351] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:19 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:21.014099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:16:21.014932 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Thu Jun 2 10:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:16:21.025186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:21.025924 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:21.033514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:21.035328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:21.036146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:21.036588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:21.184047 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:21.192248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9abe2039-f127-485b-acce-fe018a529869 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.170912 Jun 02 10:16:21.196139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 183/352] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:21 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:22.208665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:22.209600 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:22.217034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:22.217640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:22.218523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:22.219642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:22.379348 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:22.387852 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ead26603-85ac-4c45-99a0-b52b344bbea6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1371 microversion: 2.1 time: 0.183117 Jun 02 10:16:22.388422 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 170/353] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:22 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:23.406264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:23.409777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:23.432267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:23.432717 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:23.433498 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:23.435260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:23.813392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:23.830787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9b2b9547-e70b-4692-95d6-3e721cd3b674 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1565 microversion: 2.1 time: 0.424044 Jun 02 10:16:23.830787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 184/354] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:23 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1565 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:23.844604 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:23.845197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:23.853411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:23.854147 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:23.863240 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:23.863240 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:23.940936 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b508a6e6-1053-4512-ba3d-e00d25e925ec tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099772 Jun 02 10:16:23.949494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 171/355] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:16:23 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:25.517750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:25.519608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:25.526683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:25.527387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:25.528383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:25.529641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:25.747790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-43676f1c-10dc-42a7-aa10-7e1f801ba2ef req-8b6f2c47-b91c-44ae-b7f3-2fa3e9e50bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:25.753666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:25.768144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-77c5a8cf-6372-4b05-8f2b-6f4cc5f3924c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1593 microversion: 2.1 time: 0.254594 Jun 02 10:16:25.775733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 185/356] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:25 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1593 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:25.778250 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-43676f1c-10dc-42a7-aa10-7e1f801ba2ef req-8b6f2c47-b91c-44ae-b7f3-2fa3e9e50bd9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:25.778926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-43676f1c-10dc-42a7-aa10-7e1f801ba2ef req-8b6f2c47-b91c-44ae-b7f3-2fa3e9e50bd9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:25.813878 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-43676f1c-10dc-42a7-aa10-7e1f801ba2ef req-8b6f2c47-b91c-44ae-b7f3-2fa3e9e50bd9 service nova] Creating event network-changed:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:16:25.825890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-43676f1c-10dc-42a7-aa10-7e1f801ba2ef req-8b6f2c47-b91c-44ae-b7f3-2fa3e9e50bd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081580 Jun 02 10:16:25.838767 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 172/357] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:16:28.798995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8f68218a-aec7-476f-b21d-75cee88d5fd8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Action: 'create', calling method: .version_select at 0x7f49de7b7ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1204552918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFbt8pUJAC37XDQZfSlvodJCAOg2fj+q9Ht/n4bAI3KODkp6i82s935wg04pQVep2/iu6Cc8xFc1H+VXqOgORfkIvTw3xk+kWwk0MoVNyEc4JqyWmToBYqP4L8YYvY1WQ=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:28.814930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-8f68218a-aec7-476f-b21d-75cee88d5fd8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:16:28.819597 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-8f68218a-aec7-476f-b21d-75cee88d5fd8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for user 722fc8b42ea941499a56937ce0d8ad3a and project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:16:28.909667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8f68218a-aec7-476f-b21d-75cee88d5fd8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.382234 Jun 02 10:16:28.910297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 186/358] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:16:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:29.407554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:16:29.408393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Thu Jun 2 10:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:16:29.460699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-25ce1008-df78-47ea-a4ea-3cca99a06016 req-7b4910dc-f2c6-461d-9e31-a7292f89f71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:29.473444 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-25ce1008-df78-47ea-a4ea-3cca99a06016 req-7b4910dc-f2c6-461d-9e31-a7292f89f71c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:29.473444 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-25ce1008-df78-47ea-a4ea-3cca99a06016 req-7b4910dc-f2c6-461d-9e31-a7292f89f71c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:29.481999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-25ce1008-df78-47ea-a4ea-3cca99a06016 req-7b4910dc-f2c6-461d-9e31-a7292f89f71c service nova] Creating event network-changed:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:16:29.487266 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-25ce1008-df78-47ea-a4ea-3cca99a06016 req-7b4910dc-f2c6-461d-9e31-a7292f89f71c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031956 Jun 02 10:16:29.487954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 173/359] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:32.980293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-675103803"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:32.980936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:32.987425 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:32.987887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:32.988796 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:32.989284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:33.193230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.network.security_group_api [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Adding security group 330f701e-6ecc-4dbc-b915-cb918efec099 to port 6e7f6cd7-2553-4013-b7ea-656e8c9454c6 Jun 02 10:16:33.887969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-02024f6f-640a-4af5-aa50-96cb5263cb2b tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.912365 Jun 02 10:16:33.888743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 187/360] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:16:32 2022] POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:16:33.899235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:33.899940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:33.910452 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:33.914274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:33.914274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:33.916266 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-91c696dd-7523-464b-891a-98b2e08f25d9 req-a809b2fa-7209-4524-9b11-62a70badbdbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:33.916412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:33.928779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-91c696dd-7523-464b-891a-98b2e08f25d9 req-a809b2fa-7209-4524-9b11-62a70badbdbc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:33.930957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-91c696dd-7523-464b-891a-98b2e08f25d9 req-a809b2fa-7209-4524-9b11-62a70badbdbc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:33.941073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=72 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:33.961184 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-91c696dd-7523-464b-891a-98b2e08f25d9 req-a809b2fa-7209-4524-9b11-62a70badbdbc service nova] Creating event network-changed:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:16:33.977991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-91c696dd-7523-464b-891a-98b2e08f25d9 req-a809b2fa-7209-4524-9b11-62a70badbdbc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063073 Jun 02 10:16:33.979073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 188/361] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:34.385531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:34.401678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1530e95e-98a0-423e-9eae-b266924c6183 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1758 microversion: 2.1 time: 0.505848 Jun 02 10:16:34.403122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 174/362] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:33 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1758 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:37.642123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2068181627", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:37.740882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] validate_networks() for None {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:16:38.098453 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:16:38.098884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:16:38.099528 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:16:38.099949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:16:38.100366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:16:38.102466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:38.110746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:38.111248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:38.112062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:38.112498 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:38.130019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Getting quotas for project 715419f2d81e4b589c011b067900fabe. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:16:38.133990 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Getting quotas for user 69cdc4db9e7946cbac4116fdf9425661 and project 715419f2d81e4b589c011b067900fabe. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:16:38.144825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:16:38.147200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:16:38.270884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-38cfbbe5-1435-489d-9531-b5e85137e68a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634794 Jun 02 10:16:38.271639 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 189/363] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 10:16:38.285394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-154b4837-903c-4fe9-b8ab-03468e53520b tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:38.286009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-154b4837-903c-4fe9-b8ab-03468e53520b tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:38.341448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-154b4837-903c-4fe9-b8ab-03468e53520b tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:38.349370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-154b4837-903c-4fe9-b8ab-03468e53520b tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1215 microversion: 2.1 time: 0.068309 Jun 02 10:16:38.349943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 175/364] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:38 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:39.367817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:39.368429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:39.375553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:39.376010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:39.376863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:39.377346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:39.486025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:39.506217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e9cd0ae6-f4c5-4ea8-ab59-048a7e14fc3c tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1219 microversion: 2.1 time: 0.143527 Jun 02 10:16:39.507120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 190/365] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:39 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:40.523067 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:40.523742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:40.531398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:40.532179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:40.533063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:40.533579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:40.536470 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=51 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:40.603521 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:40.613916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2e516f26-8b6c-46c0-8e4b-3210cb8de53f tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1267 microversion: 2.1 time: 0.094108 Jun 02 10:16:40.621528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 176/366] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:40 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:41.638944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:41.649552 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:41.668351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:41.668872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:41.669658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:41.671552 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:42.109024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:42.117589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4f3864fd-9c70-4cc2-a82c-1451842ca428 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1273 microversion: 2.1 time: 0.489192 Jun 02 10:16:42.129715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 191/367] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:41 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1273 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:43.134969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:43.135625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:43.146022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:43.146022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:43.146223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:43.146566 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:43.338155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:43.357932 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6751bb7d-de6b-4c6e-9017-eaf92a7044a7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.226729 Jun 02 10:16:43.359824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 177/368] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:43 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:43.999822 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-fce3df9a-5629-43c6-a7a6-88edd5ddd9bc req-981abdee-3580-41a5-8fc7-c3fb0943e2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf765a2-3df4-419b-a53a-66821678bb93", "tag": "5657adfb-4403-46d8-abe7-56ac75db571f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:44.018633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fce3df9a-5629-43c6-a7a6-88edd5ddd9bc req-981abdee-3580-41a5-8fc7-c3fb0943e2f6 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:44.019280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fce3df9a-5629-43c6-a7a6-88edd5ddd9bc req-981abdee-3580-41a5-8fc7-c3fb0943e2f6 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:44.043536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-fce3df9a-5629-43c6-a7a6-88edd5ddd9bc req-981abdee-3580-41a5-8fc7-c3fb0943e2f6 service nova] Creating event network-changed:5657adfb-4403-46d8-abe7-56ac75db571f for instance fbf765a2-3df4-419b-a53a-66821678bb93 on hv-cinder-79760 Jun 02 10:16:44.056854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-fce3df9a-5629-43c6-a7a6-88edd5ddd9bc req-981abdee-3580-41a5-8fc7-c3fb0943e2f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060771 Jun 02 10:16:44.057522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 192/369] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:44.378667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:44.379980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:44.415073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=26 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:44.421340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:44.423391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:44.444075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:44.444075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:44.653226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:44.661514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8beddf92-1d2e-4e4c-a6c8-6d2014905cad tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.289120 Jun 02 10:16:44.662314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 178/370] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:44 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:45.680695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:45.681556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:45.688228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:45.688913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:45.690099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:45.696442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:45.857399 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:45.865886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-716c5425-71ae-41d4-bdfa-0aac77dc2d86 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.190379 Jun 02 10:16:45.866680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 193/371] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:45 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:16:46.212652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a1d373f7-afea-47ba-a999-fb36139fa476 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Action: 'create', calling method: .version_select at 0x7f49dde29dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-307942013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwIC8sZFIdB7WuI+RyL/1pM94nvlJGrL+9cloNN8yQ7E1LQZ4q9HSYHw0PsU1RehmKg84unCDiJazHGq7OggzRRdEO4LVqD3cwgIY/OFT0OEXZ5agV8zTK0COH5Ff+cYg=="}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:46.227245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-a1d373f7-afea-47ba-a999-fb36139fa476 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Getting quotas for project 520be3417a7047ef81cac4db926f3f20. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:16:46.231117 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-a1d373f7-afea-47ba-a999-fb36139fa476 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Getting quotas for user 929db9b6452f46ff9b854efb4a0d464a and project 520be3417a7047ef81cac4db926f3f20. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:16:46.345625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a1d373f7-afea-47ba-a999-fb36139fa476 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.292487 Jun 02 10:16:46.346221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 179/372] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:16:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:46.883416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:46.884021 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:46.890539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:46.890987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:46.891792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:46.892259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:47.042852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:47.053572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ed19f6b2-63c2-4826-b953-c32c4e421a73 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.174006 Jun 02 10:16:47.055947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 194/373] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:46 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:48.075477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:48.077127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:48.086289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:48.087516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:48.088855 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:48.089533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:48.273030 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:48.281850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-99470077-2569-460e-af8b-467df086dd61 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.213594 Jun 02 10:16:48.282473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 180/374] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:48 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:49.303426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:49.304056 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:49.312887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:49.317302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=10 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:49.317302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:49.317520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:49.318481 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:49.319089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:49.473706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:49.481598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4bec1494-0eca-47c6-b79f-b58018c8abb7 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.186218 Jun 02 10:16:49.482162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 195/375] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:49 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:50.499548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:50.500151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:50.507367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:50.507820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:50.508624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:50.509066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:50.643059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:50.650682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1ee1b0a9-a714-429d-b0fd-9e7391941dbc tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.155024 Jun 02 10:16:50.651276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 181/376] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:50 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:51.445355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-27066578-b36e-4cfb-bd90-cbb05de1631c req-f6418141-d59f-4ff8-a7bb-c7b4f6456cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf765a2-3df4-419b-a53a-66821678bb93", "name": "network-vif-plugged", "status": "completed", "tag": "5657adfb-4403-46d8-abe7-56ac75db571f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:51.454906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-27066578-b36e-4cfb-bd90-cbb05de1631c req-f6418141-d59f-4ff8-a7bb-c7b4f6456cc2 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:51.455369 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-27066578-b36e-4cfb-bd90-cbb05de1631c req-f6418141-d59f-4ff8-a7bb-c7b4f6456cc2 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:51.466300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-27066578-b36e-4cfb-bd90-cbb05de1631c req-f6418141-d59f-4ff8-a7bb-c7b4f6456cc2 service nova] Creating event network-vif-plugged:5657adfb-4403-46d8-abe7-56ac75db571f for instance fbf765a2-3df4-419b-a53a-66821678bb93 on hv-cinder-79760 Jun 02 10:16:51.472393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-27066578-b36e-4cfb-bd90-cbb05de1631c req-f6418141-d59f-4ff8-a7bb-c7b4f6456cc2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030587 Jun 02 10:16:51.472965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 196/377] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:51.668205 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:51.668849 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:51.675373 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:51.675828 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:51.676596 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:51.677036 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:51.815062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:51.822689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7373272f-4609-46bb-8007-c78fc1f1a3d4 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.158417 Jun 02 10:16:51.823466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 182/378] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:51 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:52.841018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:52.841715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:52.848390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:52.848844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:52.849616 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:52.850057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:52.983047 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:52.990698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3ce5b25c-9b46-4c7c-982d-ef467088b072 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.153936 Jun 02 10:16:52.991357 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 197/379] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:52 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:54.007910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:54.008648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:54.015148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:54.015597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:54.016385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:54.016816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:54.152039 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:54.161618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-788d6aa2-fead-40ea-8956-3f19640c6a23 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1315 microversion: 2.1 time: 0.157329 Jun 02 10:16:54.162018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 183/380] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:54 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:55.178255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:55.178922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:55.185709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.186171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.186943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.187414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.327042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:55.335683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1ac7eef6-c4c9-4efe-9d6b-71e0256fd22a tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1464 microversion: 2.1 time: 0.161768 Jun 02 10:16:55.336262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 198/381] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:55 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:55.375923 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:55.376463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:55.383643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.384100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.384871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.385316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.409806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:16:55.707527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d47e40ca-cbcf-4bca-89c7-f27f7cef1a78 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 204 len: 0 microversion: 2.1 time: 0.335271 Jun 02 10:16:55.708154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 184/382] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:16:55 2022] DELETE /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:16:55.716415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:55.717071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:55.724336 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.724783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.725586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:55.726018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:55.861538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:55.869832 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-43cf2a6c-e716-49a7-81ca-51e95d9d6dbd tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1470 microversion: 2.1 time: 0.157327 Jun 02 10:16:55.870393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 199/383] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:55 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:56.887520 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:56.888225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:56.890132 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:56.895843 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:56.896359 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:56.897135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:56.897576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:57.032212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:57.039965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6283e595-2f75-4282-a064-601b310c7833 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1470 microversion: 2.1 time: 0.156752 Jun 02 10:16:57.040534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 185/384] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:56 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:16:58.060724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:58.061337 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:58.068346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:58.068806 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:58.069569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:58.070008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:58.265432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-8f64b041-bad9-48f1-940b-cce232467a96 req-6ca90ce5-f1ee-47ab-bc1d-6075eae7397a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf765a2-3df4-419b-a53a-66821678bb93", "name": "network-vif-deleted", "tag": "5657adfb-4403-46d8-abe7-56ac75db571f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:16:58.280955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8f64b041-bad9-48f1-940b-cce232467a96 req-6ca90ce5-f1ee-47ab-bc1d-6075eae7397a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:58.281432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8f64b041-bad9-48f1-940b-cce232467a96 req-6ca90ce5-f1ee-47ab-bc1d-6075eae7397a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:58.293649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-8f64b041-bad9-48f1-940b-cce232467a96 req-6ca90ce5-f1ee-47ab-bc1d-6075eae7397a service nova] Creating event network-vif-deleted:5657adfb-4403-46d8-abe7-56ac75db571f for instance fbf765a2-3df4-419b-a53a-66821678bb93 on hv-cinder-79760 Jun 02 10:16:58.294888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69cdc4db9e7946cbac4116fdf9425661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715419f2d81e4b589c011b067900fabe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:16:58.300955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-8f64b041-bad9-48f1-940b-cce232467a96 req-6ca90ce5-f1ee-47ab-bc1d-6075eae7397a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Jun 02 10:16:58.300955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 186/385] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:16:58.305541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-05a291e6-4e4b-4281-9657-632f618a4fb1 tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 200 len: 1470 microversion: 2.1 time: 0.248588 Jun 02 10:16:58.306099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 200/386] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:58 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:16:59.323798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:16:59.324402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] [instance: fbf765a2-3df4-419b-a53a-66821678bb93] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:16:59.330513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:59.331483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:59.332238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:16:59.332669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:16:59.345913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] HTTP exception thrown: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Request method failure captured: Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 HTTP/1.1 Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI4D4wn5qcHIjydzlExdPT1_Cyx7nQSeRXfbl04Dqtr0Kxcvz9mcuijrFaaP14mXnHlQLEQe9B3Fr41ssJTc1sFBafDxLfagD3febdklJhEMUAMIsjNX-zjf6pWAvC5Ah3XzNXXw53gwF52z9yrKCB26AKH8T0sh4qhW9f2-LhWa_sI Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 715419f2d81e4b589c011b067900fabe Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesNegativeTest-1287467741 Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:16:59.348206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/715419f2d81e4b589c011b067900fabe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_715419f2d81e4b589c011b067900fabe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/715419f2d81e4b589c011b067900fabe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/715419f2d81e4b589c011b067900fabe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesNegativeTest-1287467741 Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 715419f2d81e4b589c011b067900fabe Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesNegativeTest-1287467741 Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesNegativeTest-1287467741-project Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 69cdc4db9e7946cbac4116fdf9425661 Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesNegativeTest-1287467741-project Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. Jun 02 10:16:59.349869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'fbf765a2-3df4-419b-a53a-66821678bb93'} Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:16:59.350870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. Jun 02 10:16:59.353080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:16:59.355200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] Returning 404 to user: Instance fbf765a2-3df4-419b-a53a-66821678bb93 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:16:59.355200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3eaa8d50-a69b-4510-86fc-a028bb80021e tempest-VolumesNegativeTest-1287467741 tempest-VolumesNegativeTest-1287467741-project] 10.222.0.13 "GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93" status: 404 len: 111 microversion: 2.1 time: 0.030594 Jun 02 10:16:59.355200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 187/387] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:16:59 2022] GET /compute/v2.1/servers/fbf765a2-3df4-419b-a53a-66821678bb93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:17:00.416571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1896679946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204552918", "security_groups": [{"name": "tempest-secgroup-smoke-1262281755"}], "block_device_mapping_v2": [{"uuid": "d33d0f91-3544-40ec-bd53-7d08d346feae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49c7bda1-edb9-41b1-8d14-2f7579277ee0"}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:00.541185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] validate_networks() for [('49c7bda1-edb9-41b1-8d14-2f7579277ee0', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:17:00.664421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:00.664988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:00.671494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:00.671952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:00.672727 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:00.673211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:00.697718 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c40309ff-6ec2-45e6-90f9-27502f31c597 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.037063 Jun 02 10:17:00.698236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 188/388] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:17:00 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:17:00.936362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:17:00.936783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:17:00.937248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:17:00.937648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:17:00.938051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:17:00.947443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:00.947932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:00.948668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:00.949098 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:00.978030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:17:00.978487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for user 722fc8b42ea941499a56937ce0d8ad3a and project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:17:01.038991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:17:01.041548 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d33d0f91-3544-40ec-bd53-7d08d346feae',volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:17:01.603463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3d9d64b9-8401-402f-8551-fe0f23b52d57 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.190531 Jun 02 10:17:01.604453 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 201/389] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:17:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:17:01.616490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-00379ee0-77ee-421f-b418-f48b8e4fa840 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:01.625988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-00379ee0-77ee-421f-b418-f48b8e4fa840 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:01.685769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-00379ee0-77ee-421f-b418-f48b8e4fa840 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:01.692974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-00379ee0-77ee-421f-b418-f48b8e4fa840 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1095 microversion: 2.1 time: 0.082225 Jun 02 10:17:01.693740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 189/390] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:01 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:02.710615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:02.711194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:02.717999 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:02.718452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:02.719240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:02.719681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:02.784817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:02.792597 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fe4d0dd7-bc67-4d1f-a10a-fa5ecfc4cdc4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1145 microversion: 2.1 time: 0.086654 Jun 02 10:17:02.793161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 202/391] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:02 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:03.609187 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:03.610236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:03.618224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:03.618675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:03.619465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:03.619900 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:03.811519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:03.812313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:03.819886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:03.820906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:03.821967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:03.822906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:03.901539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:03.911886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5ed1b730-d973-4c28-bac3-900c014413f8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1193 microversion: 2.1 time: 0.104417 Jun 02 10:17:03.912473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 203/392] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:03 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:04.466600 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dc5ad9a2-853c-43e2-8b58-f1cb5dc81899 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860725 Jun 02 10:17:04.467506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 190/393] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:17:03 2022] POST /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:04.929259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:04.929903 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:04.936606 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:04.937053 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:04.937839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:04.938265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:05.011673 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:05.019792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c951414f-5cca-4a11-90d1-bb6de8d68f7e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1211 microversion: 2.1 time: 0.094428 Jun 02 10:17:05.020363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 204/394] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:04 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:06.043166 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:06.044031 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:06.059474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:06.061417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:06.061417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:06.061417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:06.225512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:06.233298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-db1028e8-681c-4a54-a37f-9bc7cbceb145 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.200154 Jun 02 10:17:06.233871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 191/395] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:06 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:06.366906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-af20ea1b-3115-4ae6-962c-9e4d9fbcfca7 req-02b2c9c8-d01e-4ed4-82cf-20819e48445c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344510b0-0870-4e81-bd36-06531d08f864", "tag": "8f738bf2-f49b-4284-9052-c624f770e61f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:06.381109 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-af20ea1b-3115-4ae6-962c-9e4d9fbcfca7 req-02b2c9c8-d01e-4ed4-82cf-20819e48445c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:06.397982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-af20ea1b-3115-4ae6-962c-9e4d9fbcfca7 req-02b2c9c8-d01e-4ed4-82cf-20819e48445c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:06.397982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-af20ea1b-3115-4ae6-962c-9e4d9fbcfca7 req-02b2c9c8-d01e-4ed4-82cf-20819e48445c service nova] Creating event network-changed:8f738bf2-f49b-4284-9052-c624f770e61f for instance 344510b0-0870-4e81-bd36-06531d08f864 on hv-cinder-79760 Jun 02 10:17:06.403075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-af20ea1b-3115-4ae6-962c-9e4d9fbcfca7 req-02b2c9c8-d01e-4ed4-82cf-20819e48445c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040448 Jun 02 10:17:06.403728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 205/396] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:17:07.250438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:07.251028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:07.257865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:07.269017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:07.269017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:07.269017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:07.390979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:07.397709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c1fc9928-64b8-4709-9000-410f25fa91a4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.151164 Jun 02 10:17:07.398270 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 192/397] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:07 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:08.415175 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:08.415924 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:08.422332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:08.422800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:08.423593 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:08.424032 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:08.432625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=84 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:08.560245 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:08.567654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-283b5216-dfcb-46eb-8f3a-8144fb1e2285 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.157154 Jun 02 10:17:08.568216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 206/398] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:08 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:09.584939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:09.585587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:09.592071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:09.592517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:09.593279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:09.593716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:09.609575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:09.727437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:09.734759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4b9c43f1-9dfd-4cf6-8e8c-0edc35975bd5 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.154245 Jun 02 10:17:09.735358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 193/399] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:09 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:10.752141 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:10.753361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:10.755666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:10.760458 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:10.760913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:10.761681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:10.762120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:10.897888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:10.905248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bde7eeef-94a0-4760-bf21-18d32b0ae78c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.157030 Jun 02 10:17:10.905807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 207/400] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:10 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:11.921544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:11.922186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:11.924482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:11.929257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:11.929705 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:11.930494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:11.930926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:12.067791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:12.076257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2ae22de5-2865-4980-ae5a-fbd9c4dcf3cb tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.158477 Jun 02 10:17:12.077180 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 194/401] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:11 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:13.014821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9bd54f45-f3fd-4d05-819b-e42b2ab6c39a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: .version_select at 0x7f49de7a2670>, body: {"keypair": {"name": "tempest-keypair-1937632763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOxtT7UHwJZroTizN/NuMGExN2U1rc3+1+vcxpIu6M7A1iTsAcXxctahTMqO3FafsGPMOUAFATCAf6ES4x5MDNpQPfUBlaAdgEq+gBrTfij7Ibpcm8QyPPp70L3hYN2+A=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:13.018806 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:13.019508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:13.030323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-9bd54f45-f3fd-4d05-819b-e42b2ab6c39a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:17:13.034805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-9bd54f45-f3fd-4d05-819b-e42b2ab6c39a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:17:13.093628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:13.094163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:13.101092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:13.101542 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:13.102304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:13.102748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:13.138672 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9bd54f45-f3fd-4d05-819b-e42b2ab6c39a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127633 Jun 02 10:17:13.139312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 208/402] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:17:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:13.235846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:13.244185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-531ce258-5ea4-4e50-a273-dfee59dd8dd0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.154492 Jun 02 10:17:13.244973 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 195/403] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:13 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:14.260856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:14.261472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:14.269397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:14.269710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:14.270480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:14.270921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:14.495487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:14.503649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1cf7e360-ae8e-49bf-b8c1-db7eebdd33ca tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.247184 Jun 02 10:17:14.504211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 209/404] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:14 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:15.484733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-898546750", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63a76883-1c17-4c5d-93bd-cf38b26e86c2"}], "security_groups": [{"name": "tempest-securitygroup--521346689"}], "key_name": "tempest-keypair-1937632763", "user_data": "}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:15.492091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:15.520720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:15.521352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:15.527998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:15.528347 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:15.529105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:15.529535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:15.601474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] validate_networks() for [('63a76883-1c17-4c5d-93bd-cf38b26e86c2', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:17:15.660487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:15.668459 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9efbe2fa-46e0-4bad-a7c3-2916e7ea67c8 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.151984 Jun 02 10:17:15.669035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 210/405] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:15 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:15.965689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:17:15.966121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:17:15.966604 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:17:15.967020 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:17:15.967461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:17:15.976648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:15.977100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:15.977902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:15.978342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:15.995648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:17:15.999595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:17:16.010919 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:17:16.013205 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:17:16.163082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-af311d4f-8743-4a2a-b7fc-6650c2d9164e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682537 Jun 02 10:17:16.163739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 196/406] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:17:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:17:16.173704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2c526bda-89a9-44cc-aa85-c58203f51c4f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:16.174997 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2c526bda-89a9-44cc-aa85-c58203f51c4f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:16.227792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2c526bda-89a9-44cc-aa85-c58203f51c4f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:16.234514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2c526bda-89a9-44cc-aa85-c58203f51c4f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1241 microversion: 2.1 time: 0.064712 Jun 02 10:17:16.235070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 211/407] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:16 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:16.316677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1500311757", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-307942013", "security_groups": [{"name": "tempest-secgroup-smoke-1848934521"}], "networks": [{"uuid": "3c699ed0-b84e-4c98-ac5e-43ba2e427c3d"}], "block_device_mapping_v2": [{"uuid": "4a9ec219-0848-4672-9889-992200805b29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:16.433606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] validate_networks() for [('3c699ed0-b84e-4c98-ac5e-43ba2e427c3d', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:17:16.684972 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:16.685584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:16.692851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:16.698092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:16.698092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:16.698092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:16.797978 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:17:16.798469 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:17:16.798866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:17:16.799342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:17:16.799926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:17:16.810197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:16.810653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:16.811492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:16.811935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:16.829308 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Getting quotas for project 520be3417a7047ef81cac4db926f3f20. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:17:16.832648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:16.833949 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Getting quotas for user 929db9b6452f46ff9b854efb4a0d464a and project 520be3417a7047ef81cac4db926f3f20. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:17:16.840241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a6524e22-004e-4761-8a7d-139ebff68557 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.159127 Jun 02 10:17:16.840809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 212/408] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:16 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:16.895721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:17:16.897732 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a9ec219-0848-4672-9889-992200805b29',volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:17:17.240351 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9b119742-c103-4830-9346-d1c99c5ea8f5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.927216 Jun 02 10:17:17.240951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 197/409] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:17:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:17:17.251049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e6bc9a76-63ea-4dd6-b9a5-787a5c82d94e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:17.251691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e6bc9a76-63ea-4dd6-b9a5-787a5c82d94e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:17.253008 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:17.253646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:17.270772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:17.270772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:17.270772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:17.270772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:17.308064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e6bc9a76-63ea-4dd6-b9a5-787a5c82d94e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:17.316926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e6bc9a76-63ea-4dd6-b9a5-787a5c82d94e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1088 microversion: 2.1 time: 0.069454 Jun 02 10:17:17.326807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 213/410] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:17 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1088 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:17.347473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:17.356680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-617a3759-c250-4b61-bdbe-4bd8f8620238 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1245 microversion: 2.1 time: 0.108337 Jun 02 10:17:17.357483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 198/411] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:17 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:17.857262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:17.857878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:17.866146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:17.866996 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:17.867813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:17.868256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:18.005253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:18.008455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-48dff99b-2384-41ba-8738-a17b1f31a821 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.155231 Jun 02 10:17:18.009064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 214/412] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:17 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:18.334663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:18.334663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:18.341449 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:18.342319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:18.342659 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:18.343107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:18.379301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:18.379922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:18.389630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:18.390350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:18.391328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:18.391763 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:18.424850 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:18.433511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-18780792-d323-4cd9-8c8e-76779452f29f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1138 microversion: 2.1 time: 0.103444 Jun 02 10:17:18.434103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 199/413] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:18 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1138 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:18.476347 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:18.483913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5053167f-8c69-4447-8ae7-eb893bd452ca tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1311 microversion: 2.1 time: 0.108455 Jun 02 10:17:18.484478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 215/414] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:18 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:19.025679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:19.026386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:19.035125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.035918 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.036295 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.036734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.177890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:19.185614 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-82135f09-a136-47e1-aba0-54a398bec66c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.164071 Jun 02 10:17:19.186206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 200/415] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:19 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:19.449855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:19.450470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:19.457051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.457504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.458294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.458730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.501572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:19.502845 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:19.509261 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.509706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.510608 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.511188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.574169 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:19.586182 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3c5bb745-886c-4b57-8b92-a9d4e6bca499 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1194 microversion: 2.1 time: 0.140173 Jun 02 10:17:19.588536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 216/416] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:19 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:19.680290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-5da3c2bb-fa6d-4ec1-a0d7-9c586431c2e6 req-bf2cbe39-abe1-42c5-864a-eb7a47c3b2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344510b0-0870-4e81-bd36-06531d08f864", "name": "network-vif-plugged", "status": "completed", "tag": "8f738bf2-f49b-4284-9052-c624f770e61f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:19.692609 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-5da3c2bb-fa6d-4ec1-a0d7-9c586431c2e6 req-bf2cbe39-abe1-42c5-864a-eb7a47c3b2cf service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:19.693047 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-5da3c2bb-fa6d-4ec1-a0d7-9c586431c2e6 req-bf2cbe39-abe1-42c5-864a-eb7a47c3b2cf service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:19.704847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-5da3c2bb-fa6d-4ec1-a0d7-9c586431c2e6 req-bf2cbe39-abe1-42c5-864a-eb7a47c3b2cf service nova] Creating event network-vif-plugged:8f738bf2-f49b-4284-9052-c624f770e61f for instance 344510b0-0870-4e81-bd36-06531d08f864 on hv-cinder-79760 Jun 02 10:17:19.706328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:19.710666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-5da3c2bb-fa6d-4ec1-a0d7-9c586431c2e6 req-bf2cbe39-abe1-42c5-864a-eb7a47c3b2cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033968 Jun 02 10:17:19.717561 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 217/417] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:19.718223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b78158ea-2bbf-4291-906a-557917fb3085 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.217637 Jun 02 10:17:19.718223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 201/418] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:19 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:20.203565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:20.204267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:20.211313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.211967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.212920 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.213525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.489682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:20.498006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4d4fa8a0-eedd-4f1a-8af3-4026e2257157 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.298724 Jun 02 10:17:20.507504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 218/419] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:20 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:20.607120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:20.607779 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:20.615058 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.615544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.616769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.617213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.686249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:20.695015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-44fb0410-b833-4310-9ad1-1fa6d6ff733a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1204 microversion: 2.1 time: 0.093443 Jun 02 10:17:20.700344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 202/420] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:20 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:20.733519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:20.734229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:20.741758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.742212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.742987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.743542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.881228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-36630bed-1aa8-4a8a-b162-f7440e60d90d req-fc0c74b5-2ac2-432c-a453-f36c2f74ebf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e6592-8825-41a5-8feb-04019f190306", "tag": "163bd3a3-4afc-49ca-849a-e9533a83c338"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:20.891001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-36630bed-1aa8-4a8a-b162-f7440e60d90d req-fc0c74b5-2ac2-432c-a453-f36c2f74ebf9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:20.891481 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-36630bed-1aa8-4a8a-b162-f7440e60d90d req-fc0c74b5-2ac2-432c-a453-f36c2f74ebf9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:20.903941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-36630bed-1aa8-4a8a-b162-f7440e60d90d req-fc0c74b5-2ac2-432c-a453-f36c2f74ebf9 service nova] Creating event network-changed:163bd3a3-4afc-49ca-849a-e9533a83c338 for instance b21e6592-8825-41a5-8feb-04019f190306 on hv-cinder-79760 Jun 02 10:17:20.913999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-36630bed-1aa8-4a8a-b162-f7440e60d90d req-fc0c74b5-2ac2-432c-a453-f36c2f74ebf9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036928 Jun 02 10:17:20.914902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 203/421] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:20.994701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:21.004982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-06e30729-f2cc-42f7-8ae1-e573208d7c66 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.275188 Jun 02 10:17:21.006112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 219/422] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:20 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:21.515424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:21.516177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:21.523200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:21.523655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:21.524429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:21.524872 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:21.661365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:21.669245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-84d856b0-df35-4915-8ca7-f21b9467d8ba tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1267 microversion: 2.1 time: 0.158129 Jun 02 10:17:21.669822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 204/423] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:21 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:21.712510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:21.713193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:21.719564 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:21.720009 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:21.720834 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:21.721270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:21.920273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:21.929267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ae7ec1dc-0fcd-4cc1-a705-8a29e366d198 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.220758 Jun 02 10:17:21.929872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 220/424] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:21 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:22.022014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:22.022631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:22.028786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.029245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.030017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.030580 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.178476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:22.186545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e29378ca-97e8-492e-9061-02a52600ac5c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.168386 Jun 02 10:17:22.192830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 205/425] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:22 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:22.685863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:22.686585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:22.693298 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.693750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.694579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.694948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.934632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-2b418298-ab34-4a2e-b215-c84d1339b6b8 req-9a61c4ec-7c99-4675-a6c7-f1c88ccc7608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:22.944703 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-2b418298-ab34-4a2e-b215-c84d1339b6b8 req-9a61c4ec-7c99-4675-a6c7-f1c88ccc7608 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.944832 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:22.945283 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-2b418298-ab34-4a2e-b215-c84d1339b6b8 req-9a61c4ec-7c99-4675-a6c7-f1c88ccc7608 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.954393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cffed4ef-a5a2-42dd-90da-f6a3c0a5d303 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1454 microversion: 2.1 time: 0.272273 Jun 02 10:17:22.955249 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 221/426] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:22 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1454 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:22.956411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-2b418298-ab34-4a2e-b215-c84d1339b6b8 req-9a61c4ec-7c99-4675-a6c7-f1c88ccc7608 service nova] Creating event network-changed:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:17:22.960127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:22.960953 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:22.961483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-2b418298-ab34-4a2e-b215-c84d1339b6b8 req-9a61c4ec-7c99-4675-a6c7-f1c88ccc7608 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030644 Jun 02 10:17:22.962198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 206/427] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:17:22.969445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.969902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.971237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.971684 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.972530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:22.973288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:22.980162 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.980724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:22.981518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:22.981966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:23.124611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:23.127935 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:23.132527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6150008c-b17a-47df-ae4f-ee193c7c6012 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1454 microversion: 2.1 time: 0.164785 Jun 02 10:17:23.133888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 207/428] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:22 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:23.136073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-44ae5c8f-6ff8-42f1-8a19-a13c68e79b1b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.179549 Jun 02 10:17:23.136634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 222/429] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:22 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:23.203700 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:23.204315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:23.210984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:23.211466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:23.212262 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:23.212706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:23.377009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:23.384558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-191f8d3a-c0c8-477b-8349-b58117826134 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.184660 Jun 02 10:17:23.385131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 208/430] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:23 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:24.153602 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:24.154241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:24.160887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:24.161349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:24.162134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:24.162571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:24.402043 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:24.402768 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:24.410241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:24.410604 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:24.411402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:24.411834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:24.546612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:24.555143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6a75cc9d-2f92-42b4-93d3-305d08d028c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.157062 Jun 02 10:17:24.555725 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 209/431] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:24 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:24.583504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:24.590885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-99853bdd-a3c5-4b30-adca-4d37f5f1d097 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.441198 Jun 02 10:17:24.591523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 223/432] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:24 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:25.466970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-cea506bc-c345-4f0c-a832-3246083b61f6 req-45256217-5c6d-4e01-971f-2ae146c232d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "344510b0-0870-4e81-bd36-06531d08f864", "tag": "8f738bf2-f49b-4284-9052-c624f770e61f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:25.475627 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-cea506bc-c345-4f0c-a832-3246083b61f6 req-45256217-5c6d-4e01-971f-2ae146c232d7 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:25.476133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-cea506bc-c345-4f0c-a832-3246083b61f6 req-45256217-5c6d-4e01-971f-2ae146c232d7 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:25.488903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-cea506bc-c345-4f0c-a832-3246083b61f6 req-45256217-5c6d-4e01-971f-2ae146c232d7 service nova] Creating event network-changed:8f738bf2-f49b-4284-9052-c624f770e61f for instance 344510b0-0870-4e81-bd36-06531d08f864 on hv-cinder-79760 Jun 02 10:17:25.494157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-cea506bc-c345-4f0c-a832-3246083b61f6 req-45256217-5c6d-4e01-971f-2ae146c232d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 Jun 02 10:17:25.497986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 210/433] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:17:25.572072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:25.572723 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:25.579121 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:25.579588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:25.580355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:25.580786 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:25.608606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:25.609699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:25.616952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:25.617492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:25.618321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:25.618822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:25.760925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:25.768931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6127c5e6-b497-46a6-83be-dfa8e2567228 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.164451 Jun 02 10:17:25.774537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 211/434] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:25 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:25.871296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:25.879509 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ca5291d0-d125-4b9d-bbc3-756cf1f605c4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.311183 Jun 02 10:17:25.880212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 224/435] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:25 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:26.785634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:26.786244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:26.792848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:26.793292 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:26.794042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:26.794474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:26.823677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=4 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:26.840578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=12 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:26.896795 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:26.897396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:26.903604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:26.904043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:26.904798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:26.905226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:26.924442 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:26.931828 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-75f62be2-cde8-410e-9d11-ac53d8e11b33 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.150033 Jun 02 10:17:26.932426 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 212/436] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:26 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:27.172771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:27.180719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cff53188-01ae-4e2d-85ec-c267c3d6cfd1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.287946 Jun 02 10:17:27.181280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 225/437] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:26 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:27.948816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:27.949363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:27.956318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:27.956763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:27.957527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:27.957963 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:27.972931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:28.089065 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:28.097005 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-04b88bac-a234-486b-b5f3-b67a779cc417 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.152166 Jun 02 10:17:28.097576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 213/438] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:27 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:28.197765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:28.198374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:28.200383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=8 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:28.205520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:28.205964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:28.206713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:28.207164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:28.222327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:28.341001 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:28.348979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f63d8769-cc22-4d95-96fa-6a7f5e9a73d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.155133 Jun 02 10:17:28.349538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 226/439] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:28 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:29.114348 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:29.114965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:29.121735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:29.122188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:29.122959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:29.123429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:29.255028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:29.262893 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bb8352e3-aa57-44a3-828c-cd4d80e87190 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.152872 Jun 02 10:17:29.263496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 214/440] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:29 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:29.366574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:29.367218 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:29.373622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:29.374066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:29.374828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:29.375294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:29.502160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:29.509699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ce36a58c-27f2-4b7e-8fb7-7a0677f7b03f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.147344 Jun 02 10:17:29.510327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 227/441] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:29 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:29.589784 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-e00692a2-739f-406b-8d5c-5498e6112301 req-b738b237-cd8a-4ec4-a2e1-b20e8f5faeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e6592-8825-41a5-8feb-04019f190306", "name": "network-vif-plugged", "status": "completed", "tag": "163bd3a3-4afc-49ca-849a-e9533a83c338"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:29.598502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e00692a2-739f-406b-8d5c-5498e6112301 req-b738b237-cd8a-4ec4-a2e1-b20e8f5faeb4 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:29.598964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e00692a2-739f-406b-8d5c-5498e6112301 req-b738b237-cd8a-4ec4-a2e1-b20e8f5faeb4 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:29.610027 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-e00692a2-739f-406b-8d5c-5498e6112301 req-b738b237-cd8a-4ec4-a2e1-b20e8f5faeb4 service nova] Creating event network-vif-plugged:163bd3a3-4afc-49ca-849a-e9533a83c338 for instance b21e6592-8825-41a5-8feb-04019f190306 on hv-cinder-79760 Jun 02 10:17:29.615740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-e00692a2-739f-406b-8d5c-5498e6112301 req-b738b237-cd8a-4ec4-a2e1-b20e8f5faeb4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029595 Jun 02 10:17:29.616733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 215/442] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:30.172956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:30.173419 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:30.179362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.180532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.180532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.180964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.202808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f5f801f8-232f-492d-9aa1-22b53bad755b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/ips" status: 200 len: 151 microversion: 2.20 time: 0.033850 Jun 02 10:17:30.203528 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 228/443] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 2 10:17:30 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/ips => generated 151 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:17:30.279927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:30.280639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:30.287515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.287972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.288824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.289248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.422712 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:30.430880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-756cb84e-e746-4752-b17d-c836f6ff39ff tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.155148 Jun 02 10:17:30.431429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 216/444] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:30 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:30.526367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:30.526981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:30.534067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.534515 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.535345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:30.535782 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:30.667042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:30.674737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-296687ba-d3f1-418e-95a6-1b73cd69942c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.152185 Jun 02 10:17:30.675335 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 229/445] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:30 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:31.447553 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:31.448202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:31.454812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:31.455302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:31.456076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:31.456514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:31.587629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:31.595247 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4aa4ccd2-56fb-4b5d-84c4-48d4fdb5714d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.151578 Jun 02 10:17:31.595811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 217/446] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:31 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:31.691754 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:31.692349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:31.698657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:31.699114 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:31.699872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:31.700303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:31.831950 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:31.839263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-64c7da9c-a41c-486b-b4f3-07d4f0bdfde9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1366 microversion: 2.1 time: 0.151955 Jun 02 10:17:31.839814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 230/447] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:31 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:32.611827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:32.612431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:32.619125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:32.619576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:32.620374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:32.620811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:32.752673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:32.760184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3ad5781d-e618-47d4-93a1-a6a72e11e12f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.152313 Jun 02 10:17:32.760744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 218/448] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:32 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:32.855911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:32.856452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:32.863465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:32.863917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:32.864674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:32.865110 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:32.994795 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:33.002714 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4b57b387-0397-4db6-8d06-2921f9a9c9e9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1557 microversion: 2.1 time: 0.150654 Jun 02 10:17:33.003290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 231/449] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:32 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:33.019159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:33.019656 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:33.025576 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.026022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:33.026784 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.027264 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:33.102638 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0c4fcb93-3b09-4e59-9ca7-8c799e6cfddd tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087759 Jun 02 10:17:33.103262 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 219/450] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:17:33 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:33.486448 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:33.486978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:33.493150 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.493590 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:33.494390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.494817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:33.518017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lazy-loading 'flavor' on Instance uuid a1c797f6-e7bc-4bbb-8553-cb14810886e3 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:17:33.777269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:33.777868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:33.784353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.784810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:33.785640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:33.786081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:34.043944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ff556f99-e695-48d0-b23b-e3f3323c5cc4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/action" status: 202 len: 0 microversion: 2.20 time: 0.561423 Jun 02 10:17:34.044611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 232/451] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 2 10:17:33 2022] POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:17:34.064346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:34.065060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:34.071563 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:34.072020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:34.072795 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:34.073237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:34.177037 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:34.185140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0bf1487a-5aee-4a36-82b4-b56305d9eaef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.412281 Jun 02 10:17:34.185926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 220/452] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:33 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:34.208775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:34.217061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:34.218653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:34.219857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-11e6fb27-8bd4-4d43-b0c3-1430534beabc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.169878 Jun 02 10:17:34.221162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 233/453] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:34 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:34.374049 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-9f86b140-36f2-47fe-8ae8-23c33d8455cf req-33b674ce-7f73-45db-ace6-9da6851e8b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e6592-8825-41a5-8feb-04019f190306", "tag": "163bd3a3-4afc-49ca-849a-e9533a83c338"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:34.382436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-9f86b140-36f2-47fe-8ae8-23c33d8455cf req-33b674ce-7f73-45db-ace6-9da6851e8b9e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:34.382880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-9f86b140-36f2-47fe-8ae8-23c33d8455cf req-33b674ce-7f73-45db-ace6-9da6851e8b9e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:34.395409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-9f86b140-36f2-47fe-8ae8-23c33d8455cf req-33b674ce-7f73-45db-ace6-9da6851e8b9e service nova] Creating event network-changed:163bd3a3-4afc-49ca-849a-e9533a83c338 for instance b21e6592-8825-41a5-8feb-04019f190306 on hv-cinder-79760 Jun 02 10:17:34.400860 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-9f86b140-36f2-47fe-8ae8-23c33d8455cf req-33b674ce-7f73-45db-ace6-9da6851e8b9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Jun 02 10:17:34.401462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 221/454] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:35.201921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:35.202565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:35.209426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:35.209869 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:35.210633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:35.211067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:35.243745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:35.244513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:35.252685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:35.253142 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:35.253959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:35.259649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:35.411016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:35.411289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:35.418787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a9a45e8d-00e8-4d56-a87f-f9ec19a2b488 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.220684 Jun 02 10:17:35.419365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:35.419544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 234/455] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:35 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:35.421219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:35.422391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a67265de-dc5c-400a-b03e-0ca16d7cf5e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.183696 Jun 02 10:17:35.422931 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 222/456] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:35 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:36.435325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:36.435945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:36.440608 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:36.441213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:36.443020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:36.443497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:36.444266 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:36.444705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:36.447896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:36.448309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:36.449110 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:36.449554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:36.578851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:36.580468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:36.587749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:36.590342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-273d7edc-2ef3-43fb-b207-b251a964906b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.156382 Jun 02 10:17:36.590342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 235/457] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:36 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:36.590540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:36.590540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0aff711f-15ea-4102-9efb-ead16b4623bd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.154251 Jun 02 10:17:36.591072 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 223/458] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:36 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:37.604527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:37.605270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:37.608427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:37.612053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:37.612626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:37.613078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:37.613851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:37.614295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:37.616108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:37.616556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:37.617521 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:37.617875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:37.754813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:37.759475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:37.762470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fffa1c02-7899-4ed4-ae9c-af5bc0e55541 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.161822 Jun 02 10:17:37.767645 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 236/459] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:37 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:37.768714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:37.770314 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:37.771617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e46452d5-4b5d-43d8-bd59-53ecc2477167 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.167317 Jun 02 10:17:37.772270 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 224/460] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:37 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:37.780012 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-b85e7867-d5b1-4400-b68f-f458091b4029 req-3d1aa493-0307-41b6-abf2-6b819a7ecd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "name": "network-vif-plugged", "status": "completed", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:37.788062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b85e7867-d5b1-4400-b68f-f458091b4029 req-3d1aa493-0307-41b6-abf2-6b819a7ecd89 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:37.788555 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b85e7867-d5b1-4400-b68f-f458091b4029 req-3d1aa493-0307-41b6-abf2-6b819a7ecd89 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:37.798972 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-b85e7867-d5b1-4400-b68f-f458091b4029 req-3d1aa493-0307-41b6-abf2-6b819a7ecd89 service nova] Creating event network-vif-plugged:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:17:37.803855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-b85e7867-d5b1-4400-b68f-f458091b4029 req-3d1aa493-0307-41b6-abf2-6b819a7ecd89 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027556 Jun 02 10:17:37.805607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 237/461] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:17:38.779875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:38.780485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:38.787076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:38.787549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:38.788351 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:38.788791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:38.794151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:38.794928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:38.801805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:38.802260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:38.803037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:38.803501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:38.922524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:38.930614 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-decb5e7f-9628-4499-b0a9-922b79b41fb1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.154555 Jun 02 10:17:38.931202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 225/462] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:38 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:38.935308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:38.943823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:38.945326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:38.946505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1357390c-4094-411b-8d0f-11c6eb0479dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.156575 Jun 02 10:17:38.947048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 238/463] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:38 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:39.947769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:39.948385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:39.955582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:39.956035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:39.956801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:39.957241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:39.964194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:39.964790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:39.972707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:39.973808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:39.974107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:39.974540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:40.095906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:40.106075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a4df6291-57f4-40eb-b242-4168b0f2c5c2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1260 microversion: 2.1 time: 0.162086 Jun 02 10:17:40.106842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 226/464] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:39 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:40.118783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:40.128193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:40.129696 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:40.130860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-31ea050f-5a4a-49cb-abe0-a60175821506 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.170580 Jun 02 10:17:40.131462 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 239/465] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:39 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:41.122549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:41.123226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:41.129783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.130224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.130975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.131431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.148979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:41.149581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:41.152017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:41.156720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.157161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.158574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.159011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.266342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:41.271487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-de50a3ea-c3e6-4d82-a292-82ac5bd81e31 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1445 microversion: 2.1 time: 0.152685 Jun 02 10:17:41.272074 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 227/466] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:41 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:41.289681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:41.289681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:41.290411 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:41.295722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.296173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.296939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:41.297375 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:41.298331 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:41.299876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:41.301028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-15ad83bf-1a27-497c-bf27-039415d6d8a8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.155889 Jun 02 10:17:41.301586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 240/467] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:41 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:41.424098 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:41.431531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-50acb09e-9765-44da-8b76-8e50fa7f347b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1445 microversion: 2.1 time: 0.146497 Jun 02 10:17:41.432091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 228/468] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:41 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1445 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:17:42.318891 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:42.319531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:42.325919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:42.326368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:42.327144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:42.327582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:42.455812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:42.463835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:42.465458 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:42.466591 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f5c454ae-f038-4560-b65c-e8a8004a973c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.151774 Jun 02 10:17:42.467177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 241/469] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:42 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:43.446637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-7a76a068-8218-44ad-b4b0-eebfc689b5e6 req-72e430a9-63ea-4cbd-9a2b-4f79302fcc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:43.455360 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-7a76a068-8218-44ad-b4b0-eebfc689b5e6 req-72e430a9-63ea-4cbd-9a2b-4f79302fcc34 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:43.455811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-7a76a068-8218-44ad-b4b0-eebfc689b5e6 req-72e430a9-63ea-4cbd-9a2b-4f79302fcc34 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:43.467718 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-7a76a068-8218-44ad-b4b0-eebfc689b5e6 req-72e430a9-63ea-4cbd-9a2b-4f79302fcc34 service nova] Creating event network-changed:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:17:43.473341 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-7a76a068-8218-44ad-b4b0-eebfc689b5e6 req-72e430a9-63ea-4cbd-9a2b-4f79302fcc34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030192 Jun 02 10:17:43.474125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 229/470] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:43.485134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:43.486489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:43.493847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:43.494392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:43.495278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:43.495786 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:43.500045 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:43.710983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:43.719469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:43.721506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:43.722654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ccb205f9-a00c-4dee-a068-000ecc0eba45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.241461 Jun 02 10:17:43.723444 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 242/471] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:43 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:43.798717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:43.799833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:43.802024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:43.807335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:43.807785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:43.808573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:43.809642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:44.026855 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-be9c68c1-75d7-4ea8-a165-9c58fa039bad tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.232807 Jun 02 10:17:44.027723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 230/472] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:17:43 2022] POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 10:17:44.036698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:44.037304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:44.043614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:44.044058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:44.044854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:44.045286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:44.271982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:44.279887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5a5126e7-17b4-4b9c-a096-d4f4fcb1514f tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1750 microversion: 2.1 time: 0.247824 Jun 02 10:17:44.280466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 243/473] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:44 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1750 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:44.741923 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:44.742619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:44.748797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:44.749248 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:44.750010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:44.750463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:44.765735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:44.884191 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:44.892100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:44.893621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:44.894766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-309e8b41-1a62-4986-bc10-1946b97ef20e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.157866 Jun 02 10:17:44.895348 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 231/474] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:44 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:17:45.298557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:45.299231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:45.305937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:45.311128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:45.311128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:45.311128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:45.449789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:45.457685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5dec3a7c-708b-465a-927b-80b06a2f5129 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.163773 Jun 02 10:17:45.458248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 244/475] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:45 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:45.913290 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:45.913909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:45.920643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:45.928876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:45.928876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:45.928876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:46.056915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:46.065375 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:46.066885 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:46.068067 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b3fbd190-852e-48d3-a394-ac6746494fc2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.158730 Jun 02 10:17:46.068619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 232/476] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:45 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:46.475216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:46.475819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:46.482122 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:46.482559 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:46.483358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:46.483786 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:46.630896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:46.638784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4c998325-ec02-4ae1-90c4-6050ebbcb68c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.167450 Jun 02 10:17:46.639382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 245/477] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:46 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:47.085563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:47.086176 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:47.092690 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:47.093137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:47.093900 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:47.094339 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:47.229278 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:47.230480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:47.232012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:47.233163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9750e91f-e831-4b2b-aafe-83f65167326f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.151505 Jun 02 10:17:47.233715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 233/478] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:47 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:47.655932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:47.656537 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:47.662871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:47.663352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:47.664105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:47.664605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:47.802689 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:47.810696 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-33fdc263-444d-43d3-9702-082f1d4cdb8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.158648 Jun 02 10:17:47.811284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 246/479] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:47 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:48.251630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:48.252157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:48.259425 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:48.264159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:48.264159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:48.264159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:48.390482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:48.398353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:48.399892 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:48.401041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2531ca4b-5024-4c0d-a6ca-2ad10f8cd4fa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.153327 Jun 02 10:17:48.401593 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 234/480] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:48 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:48.827850 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:48.828454 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:48.835422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:48.835868 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:48.836608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:48.837042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:48.977807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:48.985948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-de00f3a3-0bbe-4900-8bad-74050b194061 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.162016 Jun 02 10:17:48.986508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 247/481] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:48 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:49.420095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:49.420708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:49.427695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:49.428148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:49.428906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:49.429342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:49.558751 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:49.567266 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:49.568771 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:49.569947 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e82b3b10-a0a8-4928-85a7-d5a538da8989 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.153739 Jun 02 10:17:49.570496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 235/482] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:49 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:49.874227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-e9b1ce48-3af5-425b-b874-b121e25e9187 req-5b9fae33-7b55-4bcc-afea-71463cb809dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "name": "network-vif-plugged", "status": "completed", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:17:49.882641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-e9b1ce48-3af5-425b-b874-b121e25e9187 req-5b9fae33-7b55-4bcc-afea-71463cb809dc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:49.883088 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-e9b1ce48-3af5-425b-b874-b121e25e9187 req-5b9fae33-7b55-4bcc-afea-71463cb809dc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:49.893808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-e9b1ce48-3af5-425b-b874-b121e25e9187 req-5b9fae33-7b55-4bcc-afea-71463cb809dc service nova] Creating event network-vif-plugged:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:17:49.898758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-e9b1ce48-3af5-425b-b874-b121e25e9187 req-5b9fae33-7b55-4bcc-afea-71463cb809dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028172 Jun 02 10:17:49.899394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 248/483] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:17:50.003595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:50.004216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:50.010268 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:50.010728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:50.011530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:50.012016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:50.156256 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:50.164954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6b3eadc5-d553-4ce6-9c30-8216c69aa37e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.165344 Jun 02 10:17:50.165520 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 236/484] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:49 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:50.588542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:50.589232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:50.595416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:50.595867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:50.596619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:50.597054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:50.721388 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:50.729173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:50.730679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:50.731851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0c46545-b4b2-42b7-8dbb-71cb82990871 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.147654 Jun 02 10:17:50.732412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 249/485] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:50 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:51.182193 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:51.182814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:51.190019 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:51.190473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:51.191284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:51.191730 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:51.334740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:51.342613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-81865f82-fed6-48e6-a9e0-645c896455d9 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.164383 Jun 02 10:17:51.343198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 237/486] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:51 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:51.749637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:51.750251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:51.756661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:51.757116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:51.757882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:51.758322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:51.888854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:51.897214 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:51.898716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:51.899893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7e1d49df-ac0a-4ba8-95bf-0836802a4dd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.154133 Jun 02 10:17:51.900447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 250/487] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:51 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:52.360854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:52.361473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:52.368275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:52.368724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:52.369515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:52.369954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:52.509350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:52.517986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8546bcb9-21a8-4d80-ace6-06081bbc8afa tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.161397 Jun 02 10:17:52.518496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 238/488] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:52 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:52.917667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:52.918273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:52.924825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:52.925279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:52.926042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:52.926483 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:53.050371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:53.058192 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:53.059774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:53.060929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1489c59d-c16f-4a72-a478-3626f9539d39 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1745 microversion: 2.20 time: 0.147153 Jun 02 10:17:53.061487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 251/489] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:52 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1745 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:53.535719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:53.536332 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:53.552657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:53.552657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:53.552657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:53.552657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:53.686630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:53.694719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5f23ddb0-0fe0-4b67-a708-6284abb10f8d tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.163576 Jun 02 10:17:53.695319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 239/490] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:53 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:54.079919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:54.081485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:54.086813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:54.087293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:54.088096 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:54.088485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:54.223205 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:54.231079 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:54.232595 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:54.233746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9a5951fe-a465-4f1a-b08c-a8d353e356c4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.158293 Jun 02 10:17:54.234302 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 252/491] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:54 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:54.711869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:54.712602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:54.719639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:54.720093 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:54.721138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:54.721345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:54.889040 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:54.898768 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9262ad57-ed36-4b71-884c-0fe73b06597c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.190752 Jun 02 10:17:54.899383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 240/492] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:54 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:55.258945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:55.259505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:55.273532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:55.274058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:55.274920 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:55.275615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:55.696420 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:55.706531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:55.708439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:55.709667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8aa86d3f-54a5-4916-a77d-6711e29d1c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.454933 Jun 02 10:17:55.710318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 253/493] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:55 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:55.916923 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:55.918323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:55.925737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:55.926384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:55.927362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:55.928239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:56.087806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:56.096721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-70560db4-de63-4423-a66f-0169859bca8e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.183510 Jun 02 10:17:56.103138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 241/494] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:55 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:56.728409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:56.729044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:56.735241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:56.735685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:56.736440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:56.736872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:56.919332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:56.929363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:56.931083 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:56.932345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b34f1c20-3fec-44d7-b0d4-ce55744e833d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.207834 Jun 02 10:17:56.932984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 254/495] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:56 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:57.117304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:57.118095 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:57.124915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:57.125377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:57.126146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:57.126589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:57.289666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:57.298130 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-04a434e7-b09a-40e0-814e-620c5e061783 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.184986 Jun 02 10:17:57.298709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 242/496] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:57 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:57.951086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:57.951716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:57.958835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:57.959320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:57.960082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:57.960551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:58.225923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:58.234745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:58.236398 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:58.237589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7b34af16-ca86-4ac5-bfad-0fb17e506874 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.290541 Jun 02 10:17:58.238264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 255/497] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:57 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:58.317269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:58.318684 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:58.325799 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:58.326267 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:58.327075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:58.327571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:58.491162 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:58.499904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-04aed183-ed36-48b2-b2c9-45c8455ceff7 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.187460 Jun 02 10:17:58.501244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 243/498] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:58 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:17:59.278186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:59.280359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:59.290241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:59.290779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:59.291616 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:59.292054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:59.434024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:59.446694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:59.448225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:59.449591 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9e9334a5-ba08-4f19-89b1-2d715d9e9c22 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.195671 Jun 02 10:17:59.450264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 256/499] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:17:59 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:17:59.519231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:17:59.520604 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:17:59.527775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:59.528229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:59.529136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:17:59.529578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:17:59.746201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:17:59.754605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1509ec71-b249-4feb-a9dc-d6423ae59150 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.240838 Jun 02 10:17:59.755197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 244/500] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:17:59 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:00.468727 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:00.469318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:00.475824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:00.476327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:00.477205 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:00.477659 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:00.615621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:00.624875 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:00.626392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:00.628136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1576fc0b-dbc0-40b0-ace3-682ab5324985 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.163448 Jun 02 10:18:00.628690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 257/501] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:00 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:00.772246 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:00.772981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:00.779545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:00.779994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:00.780749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:00.781183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:00.937606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:00.951802 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fc44202a-2d05-41ca-bd48-a341d5fb9400 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1755 microversion: 2.1 time: 0.183201 Jun 02 10:18:00.952386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 245/502] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:00 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:01.645702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:01.646305 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:01.652854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:01.653293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:01.655615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:01.656062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:01.798824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:01.808263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:01.809836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:01.822098 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7c7a7972-9806-487a-b985-e163852dbe28 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.169167 Jun 02 10:18:01.822098 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 258/503] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:01 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:01.973271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:01.973976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:01.982371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:01.983208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:01.984231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:01.984678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:02.179501 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:02.187750 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-393c2eb0-4a09-42cc-873c-837053a4ac79 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1758 microversion: 2.1 time: 0.220920 Jun 02 10:18:02.190001 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 246/504] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:01 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:02.829754 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:02.831659 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:02.838341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:02.839054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:02.840061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:02.840739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:02.861200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:02.987179 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:02.995972 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:02.997720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:02.998873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3a7e6198-6210-4cba-a72b-504c618ca0de tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.173091 Jun 02 10:18:03.001362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 259/505] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:02 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:04.017269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:04.018051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:04.025293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:04.025676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:04.026588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:04.027052 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:04.176924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:04.185524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:04.187023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:04.188256 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7a07f97f-005c-425d-8da0-c26da23c46f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.175133 Jun 02 10:18:04.188822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 247/506] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:04 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:05.207579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:05.209154 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:05.216038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:05.216778 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:05.218341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:05.219293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:05.440147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:05.448775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:05.450282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:05.451477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a0bd80f7-bf28-441c-b7ab-b714314415cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.248331 Jun 02 10:18:05.452774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 260/507] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:05 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:06.470666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:06.471319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:06.477749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:06.478190 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:06.478941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:06.479421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:06.483206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:06.607275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:06.616122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:06.617634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:06.618846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-db1cffee-7579-49e4-8a14-91939b51f613 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1740 microversion: 2.20 time: 0.152036 Jun 02 10:18:06.619464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 248/508] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:06 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:07.637404 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:07.638044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:07.645229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:07.645690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:07.646426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:07.646856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:07.772414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:07.780166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:07.781652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:07.782781 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b6974441-c107-4e75-b6e0-7983fc39c79b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1722 microversion: 2.20 time: 0.149256 Jun 02 10:18:07.783405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 261/509] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:07 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:08.800735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:08.801340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:08.807894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:08.808335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:08.809100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:08.809526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:08.940396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:08.948240 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:08.949679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:08.950815 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9806aec4-36b1-46c0-af9c-a45bd0cbff12 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1722 microversion: 2.20 time: 0.154603 Jun 02 10:18:08.951385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 249/510] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:08 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:09.846822 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-aba323cc-0f9e-474c-9029-009efcad855a req-e7224c93-810f-4502-a3a0-01faf5dd107a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "name": "network-vif-unplugged", "status": "completed", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:09.855418 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-aba323cc-0f9e-474c-9029-009efcad855a req-e7224c93-810f-4502-a3a0-01faf5dd107a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:09.856198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-aba323cc-0f9e-474c-9029-009efcad855a req-e7224c93-810f-4502-a3a0-01faf5dd107a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:09.867231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-aba323cc-0f9e-474c-9029-009efcad855a req-e7224c93-810f-4502-a3a0-01faf5dd107a service nova] Creating event network-vif-unplugged:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:18:09.872447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-aba323cc-0f9e-474c-9029-009efcad855a req-e7224c93-810f-4502-a3a0-01faf5dd107a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029345 Jun 02 10:18:09.873035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 262/511] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:09.969013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:09.970384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:09.977818 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:09.978437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:09.979629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:09.980283 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:10.112284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:10.120967 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:10.122516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:10.123696 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0f08fea2-18bf-4fbb-80eb-f1de4e68c894 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1725 microversion: 2.20 time: 0.158975 Jun 02 10:18:10.124257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 250/512] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:09 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:10.141490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c27ffc4-e49e-4965-9bf5-5a526013e948"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:10.142681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:10.148971 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:10.149412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:10.150181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:10.150622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.094166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0c9f9906-960d-4f68-afe9-85e33908bb18 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.956854 Jun 02 10:18:11.095202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 263/513] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 2 10:18:10 2022] POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 188 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:18:11.208820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:11.209387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:11.215940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.216387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.217183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.217686 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.497713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8e5a6dfd-3965-493e-9cce-ea54dba7c34b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/action" status: 202 len: 0 microversion: 2.20 time: 0.292797 Jun 02 10:18:11.498232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 251/514] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 2 10:18:11 2022] POST /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:18:11.506677 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:11.507331 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:11.510300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=48 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:11.513810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.514262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.515026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.515486 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.656460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:11.664917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:11.666430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:11.667617 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a0f85eb8-e0eb-4cd9-a2a0-734083afe33f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1751 microversion: 2.20 time: 0.164796 Jun 02 10:18:11.668167 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 264/515] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:11 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:11.836990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aab92970-cc1d-4ecd-9036-f80b482fc060"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:11.842073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:11.844928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.845406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:11.846161 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:11.846591 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:12.540173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-715862a0-7b14-4309-b2a7-6382f498cad9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812506 Jun 02 10:18:12.540713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 252/516] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:18:11 2022] POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:12.685534 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:12.686143 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:12.693057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:12.693506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:12.694274 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:12.694711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:12.832454 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:12.840690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:12.842213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:12.843373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9da3b3b6-7c65-48af-bf14-35cf7236e1dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1751 microversion: 2.20 time: 0.161742 Jun 02 10:18:12.843954 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 265/517] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:12 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:13.863436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:13.864076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:13.871023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:13.871514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:13.872287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:13.872731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:14.002986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:14.008674 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:14.010254 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:14.011461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-69247998-6911-4da7-8c7f-ae30b8dc6f98 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.152953 Jun 02 10:18:14.012023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 253/518] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:13 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:15.029666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:15.030303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:15.036784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:15.037224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:15.037978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:15.038413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:15.162487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:15.170745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:15.172294 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:15.173943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7221c0c1-f90b-4cb7-a7f7-2f1cfbd4e734 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.147649 Jun 02 10:18:15.174498 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 266/519] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:15 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:16.191757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:16.192398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:16.194775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=50 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:16.199566 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:16.200014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:16.200777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:16.201216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:16.332293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:16.340778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:16.342281 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:16.343455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5041892e-c024-498c-b218-99bfcaf2a3cd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.155539 Jun 02 10:18:16.344009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 254/520] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:16 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:17.362472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:17.363068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:17.369816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:17.370258 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:17.371005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:17.371465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:17.499682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:17.507874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:17.509362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:17.510501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7a9062bd-3d24-448b-9b1b-b84c6a337297 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.152400 Jun 02 10:18:17.511051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 267/521] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:17 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:18.527587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:18.528197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:18.534683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:18.535144 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:18.535906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:18.536345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:18.666990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:18.675712 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:18.677267 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:18.678406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b49e1af8-0f26-4d9a-a191-cc9f531243b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.154771 Jun 02 10:18:18.678968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 255/522] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:18 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:19.696991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:19.697604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:19.704031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:19.705054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:19.705802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:19.706231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:19.833848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:19.842348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:19.843917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:19.845127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6b0755f4-06a2-4abe-a9a0-1adfae1393a0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.151936 Jun 02 10:18:19.845679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 268/523] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:19 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:20.863245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:20.863854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:20.871003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:20.871531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:20.872344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:20.872778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:21.004658 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:21.013543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:21.015053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:21.016621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f3d5c463-016b-4cf7-9baa-65daefe8c8db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1753 microversion: 2.20 time: 0.157139 Jun 02 10:18:21.017846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 256/524] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:20 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:21.080003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:21.081038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:21.087704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:21.095575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:21.095575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:21.095575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:21.112086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'flavor' on Instance uuid ff7d784a-1d47-43a3-b903-4321aa0bf0fe {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:18:21.453987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b244e592-93af-49d0-b402-9ff92560f766 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/action" status: 200 len: 32 microversion: 2.1 time: 0.378164 Jun 02 10:18:21.455054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 269/525] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:18:21 2022] POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:18:21.464120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:21.464979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:21.471317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:21.471864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:21.472832 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:21.473337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:21.605881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:21.615569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b207d0e4-0df9-418f-ab47-66b023c19cbe tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.155271 Jun 02 10:18:21.616224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 257/526] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:21 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:22.040018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:22.040711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:22.046752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:22.047247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:22.048541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:22.048980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:22.332976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:22.341674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:22.343243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:22.344456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f9c7075c-649d-4bc9-9b34-2e580f715dbc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.308698 Jun 02 10:18:22.345764 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 270/527] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:22 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:22.634625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:22.635490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:22.643692 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:22.644366 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:22.645438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:22.645877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:22.783694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:22.791198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b936b724-39ac-42e4-888c-9b931ec0ea44 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.162244 Jun 02 10:18:22.797481 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 258/528] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:22 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:23.363625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:23.364286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:23.371368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:23.372262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:23.372625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:23.373083 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:23.523159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:23.534428 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:23.536290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:23.538416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-82760189-fbe7-4cf0-902e-d9303e7c64b6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.179150 Jun 02 10:18:23.539579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 271/529] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:23 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:23.807718 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:23.808328 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:23.815046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:23.815566 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:23.816331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:23.816769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:23.952188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:23.960687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2d32a119-7b27-4b8c-88ec-43a541e84323 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.156813 Jun 02 10:18:23.961253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 259/530] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:23 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:24.557495 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:24.558097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:24.565274 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:24.565720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:24.566484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:24.566916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:24.569733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:24.700411 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:24.709808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:24.711329 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:24.712493 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bd2605ee-f114-48a4-9d95-e6044fe8c9e0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.158940 Jun 02 10:18:24.713036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 272/531] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:24 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:24.978746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:24.980358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:24.988708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:24.989168 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:24.990397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:24.990796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:25.343464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:25.352219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-34125f81-6f89-4847-a9ed-1f7c6f3c0db5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.377837 Jun 02 10:18:25.352789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 260/532] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:24 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:25.730960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:25.731593 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:25.737897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:25.738340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:25.739087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:25.739791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:25.873857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:25.883063 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:25.884597 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:25.885769 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-76e9635f-cdf7-46ca-ac35-09edd366ef31 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.158823 Jun 02 10:18:25.886323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 273/533] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:25 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:26.369756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:26.370395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:26.378222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:26.378709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:26.379631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:26.380098 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:26.514789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:26.522854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5bf3ae1c-6dfd-44de-8a1a-0c4aa50f9904 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.157481 Jun 02 10:18:26.523417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 261/534] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:26 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:26.904831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:26.905417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:26.911995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:26.912439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:26.913221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:26.913651 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:27.052505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:27.059332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:27.060860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:27.062031 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7855fd50-24fb-4a9b-b63d-d42e69d2cc3b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.161258 Jun 02 10:18:27.062587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 274/535] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:26 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:27.541928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:27.542538 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:27.549578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:27.550022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:27.550772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:27.551235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:27.565634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:27.693178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:27.706139 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-caf6deb3-02ce-4ed5-a305-81705510acb4 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.168120 Jun 02 10:18:27.706785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 262/536] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:27 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:28.081921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:28.082601 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:28.090785 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:28.091259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:28.092076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:28.092532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:28.237889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:28.246659 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:28.248263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:28.249443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-844660b0-5ca7-44ff-9439-1ad6cbd4ce01 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.172241 Jun 02 10:18:28.249998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 275/537] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:28 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:28.724466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:28.725309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:28.732140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:28.732694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:28.733544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:28.734059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:28.890760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:28.898820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c9be265d-f784-4b44-b9b2-5013bb43f182 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.178294 Jun 02 10:18:28.899623 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 263/538] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:28 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:29.270600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:29.271978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:29.278905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:29.279468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:29.280308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:29.280813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:29.422104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:29.430513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:29.432025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:29.433207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-870300f6-e1f4-409d-ab53-aaec5a39be7a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.167257 Jun 02 10:18:29.433767 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 276/539] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:29 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:29.916484 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:29.917144 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:29.924266 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:29.924719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:29.925487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:29.925927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:30.061088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:30.069588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-05e68380-b503-4dec-8df1-c933a4caaee7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.157035 Jun 02 10:18:30.070157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 264/540] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:29 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:30.451338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:30.451951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:30.458297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:30.458742 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:30.459551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:30.459981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:30.592514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:30.602130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:30.603671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:30.604857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6b87f87d-ebe6-4444-b3c6-270bd1cb03c5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.157429 Jun 02 10:18:30.605400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 277/541] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:30 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:31.086394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:31.088194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:31.095817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:31.096639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:31.098055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:31.098729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:31.238506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:31.247624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4b457fa8-a4ec-4034-9530-8aa03095e372 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.165592 Jun 02 10:18:31.257497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 265/542] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:31 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:31.623226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:31.623812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:31.630253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:31.630709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:31.631503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:31.631945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:31.777547 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:31.786214 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:31.787759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:31.788908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-29d4a753-f00c-400f-a663-97d539f1e0db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.169695 Jun 02 10:18:31.789502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 278/543] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:31 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:32.265370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:32.269902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:32.273889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:32.274345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:32.275367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:32.275805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:32.417579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:32.425544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dc877815-8e21-47b2-aee2-fff3500f0524 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.164091 Jun 02 10:18:32.426109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 266/544] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:32 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:32.807448 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:32.808125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:32.823011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:32.823635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:32.824477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:32.824917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:32.959113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:32.968738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:32.975583 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:32.976844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c47fee17-4b72-4ad3-a11c-8bbc8ab27b08 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.173459 Jun 02 10:18:32.977543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 279/545] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:32 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:33.441634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:33.442237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:33.448613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:33.451350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:33.451350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:33.451350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:33.587859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:33.596679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d4542569-fb53-4940-9ba4-666d52d9b16f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.158823 Jun 02 10:18:33.597341 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 267/546] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:33 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:33.996633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:33.997276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:34.003858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:34.004303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:34.005059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:34.005492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:34.131956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:34.140338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:34.141830 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:34.143574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-70d3e244-50d0-4062-9b66-709279d7d690 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151004 Jun 02 10:18:34.144213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 280/547] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:33 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:34.613752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:34.614608 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:34.621048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:34.621493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:34.622244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:34.622676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:34.750989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:34.759669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cb0966d9-05e4-4ad9-98ef-28778d7c1754 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.149785 Jun 02 10:18:34.760431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 268/548] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:34 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:35.161658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:35.162240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:35.168765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:35.169206 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:35.170029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:35.170387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:35.305517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:35.314830 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:35.316357 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:35.317537 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1b6e087d-b11b-4780-ae8d-19a8a2fc765a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.159714 Jun 02 10:18:35.318060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 281/549] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:35 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:35.777341 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:35.777951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:35.784877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:35.785321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:35.786093 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:35.786511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:35.921584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:35.931237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9cdf9db0-cd89-4149-9188-2f7752cd6fa6 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.157801 Jun 02 10:18:35.932229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 269/550] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:35 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:36.337111 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:36.337719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:36.344873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:36.345313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:36.346077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:36.346516 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:36.473435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:36.481690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:36.483225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:36.484382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a7099f84-081d-4e21-b733-86def3900391 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151183 Jun 02 10:18:36.485550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 282/551] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:36 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:36.948141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:36.948776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:36.955813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:36.956259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:36.957040 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:36.957477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:37.084143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:37.092008 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-01e00571-39d3-4732-8c82-7c5169528da2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.147707 Jun 02 10:18:37.092567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 270/552] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:36 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:37.502540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:37.503184 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:37.509679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:37.510130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:37.510897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:37.511362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:37.638439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:37.647371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:37.648880 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:37.650035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-adb37128-0353-4e29-b9cb-5c6c0531bff5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151606 Jun 02 10:18:37.650591 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 283/553] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:37 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:38.108378 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:38.109000 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:38.115739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:38.116194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:38.116958 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:38.117396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:38.246061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:38.253976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6578ce55-7aff-409c-8454-42e449aaaf3d tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.149416 Jun 02 10:18:38.254543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 271/554] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:38 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:38.668483 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:38.669090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:38.675614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:38.676062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:38.676821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:38.677284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:38.805049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:38.814297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:38.816655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:38.817016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9f075b8b-4175-4f7c-ac8d-2208de8abf83 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.152418 Jun 02 10:18:38.817565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 284/555] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:38 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:39.271842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:39.271842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:39.277940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:39.278389 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:39.279183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:39.279630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:39.409230 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:39.417082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fcf0d36b-7f6c-47ad-b4cd-bc6339e1eea7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.150242 Jun 02 10:18:39.417655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 272/556] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:39 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:39.834979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:39.835609 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:39.842066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:39.842509 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:39.843295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:39.843728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:39.968874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:39.977581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:39.979076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:39.980234 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9936ec79-a27e-410b-bfa3-a70aef70c7ad tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.149210 Jun 02 10:18:39.980786 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 285/557] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:39 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:40.434787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:40.435354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:40.441689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:40.442135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:40.442886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:40.443347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:40.570232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:40.578871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e4f274d0-d8de-46e8-b055-a238943ad8bb tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.147502 Jun 02 10:18:40.579482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 273/558] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:40 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:40.998936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:40.999579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:41.006524 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:41.006978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:41.007769 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:41.008208 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:41.135580 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:41.143893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:41.145405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:41.146554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b5ca14b5-4650-404a-bd3b-0609e0601404 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151535 Jun 02 10:18:41.147125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 286/559] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:40 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:41.595837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:41.596478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:41.603007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:41.603491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:41.604251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:41.604686 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:41.734226 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:41.743044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8596baab-9a0f-4366-a2d5-91c4a1447b92 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.151653 Jun 02 10:18:41.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 274/560] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:41 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:42.164774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:42.165380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:42.167758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=46 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:42.172484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:42.172932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:42.173694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:42.174127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:42.300497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:42.308878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:42.310385 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:42.311571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e22d1990-e4b2-4e5f-83a9-448c7306373d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.150734 Jun 02 10:18:42.312126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 287/561] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:42 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:42.759876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:42.760485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:42.766902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:42.767378 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:42.768183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:42.768622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:42.899045 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:42.907309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8f8af8d3-2e81-4778-9284-0c9c118e9638 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.151168 Jun 02 10:18:42.907884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 275/562] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:42 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:43.330405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:43.331020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:43.337661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:43.338113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:43.338882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:43.339367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:43.465805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:43.468014 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:43.475288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:43.486325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:43.486325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f55586bc-d2a6-47c8-8830-475d96e6dedd tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.152067 Jun 02 10:18:43.486325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 288/563] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:43 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:43.924562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:43.925157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:43.931581 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:43.932025 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:43.932777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:43.933211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:44.066755 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:44.074658 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d7eaeeca-276f-4da9-865a-d8586437e58b tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.153976 Jun 02 10:18:44.075245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 276/564] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:43 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:44.496101 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:44.496732 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:44.504187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:44.504642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:44.505404 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:44.505845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:44.633377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:44.642310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:44.643855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:44.645057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7e900653-9770-415b-b00d-ef31a264da45 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.152951 Jun 02 10:18:44.645607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 289/565] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:44 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:45.092075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:45.092687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:45.099782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:45.100235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:45.100997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:45.101434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:45.229858 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:45.238024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e5dfb3e5-b278-4a6e-b214-c798999ccbd8 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1734 microversion: 2.1 time: 0.149805 Jun 02 10:18:45.238593 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 277/566] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:45 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:45.662929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:45.663579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:45.670262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:45.670718 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:45.671523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:45.672455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:45.795791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:45.804493 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:45.805987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:45.807166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7cc66f8c-cc59-461c-be6b-b192cffda692 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.148133 Jun 02 10:18:45.807733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 290/567] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:45 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:46.255431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:46.256054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:46.258407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=48 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:46.263302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.263758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.264568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.265004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.395208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:46.403182 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c2e0ea5a-cf7b-42b7-afff-41b3a2ca5a8c tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1714 microversion: 2.1 time: 0.151559 Jun 02 10:18:46.403751 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 278/568] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:46 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:46.457740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:46.458239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:46.464226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.464681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.465440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.465882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.587009 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] HTTP exception thrown: Cannot 'detach_volume' instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe while it is in vm_state rescued Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Request method failure captured: Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments/aab92970-cc1d-4ecd-9036-f80b482fc060 HTTP/1.1 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI0yUcoLXNG5MwP88pRdB-RsNCsaqrBtpgJ4EDDQKANbI2D6qJtW3oC0t8EUTCqzNTTZUqRm81WxOLdkAonuHyrgy7MdSLj9QeWh8ZqGHfZYAvPvdJ6WbD4dUzMymhSkYDo4-MI99qAj50EcP-VBKb1z1Wy6iT-HvRwcM0H48PLE5WQ Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:18:46.588631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: a696d00855ef439c9d80b6bec5312f20 Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:18:46.590162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Cannot 'detach_volume' instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe while it is in vm_state rescued Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'server_id': 'ff7d784a-1d47-43a3-b903-4321aa0bf0fe', 'id': 'aab92970-cc1d-4ecd-9036-f80b482fc060'} Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:18:46.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe while it is in vm_state rescued Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe while it is in vm_state rescued Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:18:46.592466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Returning 409 to user: Cannot 'detach_volume' instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe while it is in vm_state rescued {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:18:46.593612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1c85e115-37b4-4056-bfcc-3477540c1fe0 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments/aab92970-cc1d-4ecd-9036-f80b482fc060" status: 409 len: 152 microversion: 2.1 time: 0.136799 Jun 02 10:18:46.593612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 291/569] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:18:46 2022] DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments/aab92970-cc1d-4ecd-9036-f80b482fc060 => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 02 10:18:46.599411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:46.599948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:46.605874 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.606329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.607118 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.607562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.609946 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:46.817835 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b0299d55-c7a2-46bb-b81c-2fa9c70a8537 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/action" status: 202 len: 0 microversion: 2.1 time: 0.222020 Jun 02 10:18:46.818380 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 279/570] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:18:46 2022] POST /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:18:46.825920 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:46.826532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:46.826647 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:46.827465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:46.834456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.834632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.834930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.835042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.835783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.835935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:46.836221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.836330 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:46.964435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:46.965898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:46.972960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:46.973880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ae24835f-d24c-41e1-a7fd-1ee333eb6329 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1722 microversion: 2.1 time: 0.151407 Jun 02 10:18:46.974438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 280/571] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:46 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:18:46.974576 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:46.975656 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b63724b1-3495-433b-8c58-1fa58c3ae0ef tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.153800 Jun 02 10:18:46.976193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 292/572] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:46 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:47.992018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:47.992779 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:48.000486 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:48.001105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:48.007618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:48.012140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:48.012140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:48.012140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:48.021467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:48.021467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:48.021719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:48.022099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:48.163457 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:48.171965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b60caded-df0f-4cb6-912e-adb62b8618d2 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1722 microversion: 2.1 time: 0.184281 Jun 02 10:18:48.172472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 281/573] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:47 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:48.450401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:48.460198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:48.461703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:48.462869 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a2709186-2e81-4ce4-89b1-1be42fe3c5fe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.466327 Jun 02 10:18:48.463477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 293/574] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:47 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:49.189559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:49.190170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:49.196677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:49.197128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:49.197888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:49.198323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:49.331151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:49.339116 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f0dfbd2a-3f7b-40eb-af1f-3e782d4b0682 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1722 microversion: 2.1 time: 0.153843 Jun 02 10:18:49.339698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 282/575] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:49 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:49.481264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:49.481850 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:49.488365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:49.488813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:49.489845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:49.490283 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:49.617905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:49.626190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:49.627725 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:49.628882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6f57279a-e618-4392-951e-c9ab5c4be009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151485 Jun 02 10:18:49.629426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 294/576] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:49 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:50.196659 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-e55ea63c-0687-43c0-84ca-dca011d0424e req-4fd8eaf4-0792-44cf-9b83-fe845898e299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "name": "network-vif-plugged", "status": "completed", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:50.204904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e55ea63c-0687-43c0-84ca-dca011d0424e req-4fd8eaf4-0792-44cf-9b83-fe845898e299 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:50.205358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e55ea63c-0687-43c0-84ca-dca011d0424e req-4fd8eaf4-0792-44cf-9b83-fe845898e299 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:50.218807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-e55ea63c-0687-43c0-84ca-dca011d0424e req-4fd8eaf4-0792-44cf-9b83-fe845898e299 service nova] Creating event network-vif-plugged:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:18:50.223835 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-e55ea63c-0687-43c0-84ca-dca011d0424e req-4fd8eaf4-0792-44cf-9b83-fe845898e299 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084755 Jun 02 10:18:50.224402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 283/577] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:50.356633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:50.357235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:50.364255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:50.364728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:50.365482 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:50.365911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:50.495545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:50.503578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a9ffa51d-35c8-4870-83c5-e6797f388cac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1722 microversion: 2.1 time: 0.150732 Jun 02 10:18:50.504106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 295/578] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:50 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:50.646750 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:50.647475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:50.653608 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:50.654060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:50.654819 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:50.655288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:50.783146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:50.791459 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:50.792893 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:50.794035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a39e2c9c-56d5-45e4-9982-2a3069055915 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.151479 Jun 02 10:18:50.794584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 284/579] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:50 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:51.521199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:51.521776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:51.528191 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:51.528646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:51.529410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:51.529852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:51.655493 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:51.663823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d91a19a9-76f4-4a27-9472-d9482fd1ea8a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1722 microversion: 2.1 time: 0.146539 Jun 02 10:18:51.664378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 296/580] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:51 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:51.812337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:51.812942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:51.819461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:51.819909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:51.820671 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:51.821109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:51.952351 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:51.961396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:51.962941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:51.964195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ea3a840b-605a-42e9-977f-b8d44d473bba tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.155653 Jun 02 10:18:51.964747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 285/581] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:51 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:52.680729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:52.681317 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:52.688745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.689270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:52.690106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.690614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:52.833831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:52.841682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5af39ad0-4b82-43ce-82e3-4cf8f71ba9ed tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1728 microversion: 2.1 time: 0.164801 Jun 02 10:18:52.842244 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 297/582] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:18:52 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:18:52.858439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:52.858968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:52.866304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.866767 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:52.867570 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.868016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:52.943144 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9b35a586-fcb7-47cc-a0e4-316cb12e5578 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088457 Jun 02 10:18:52.943751 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 286/583] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:18:52 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:52.981870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:52.982472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:52.989256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.989694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:52.990446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:52.990875 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:53.119527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:53.127829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:53.129358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:53.130504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5d6799f4-90b4-4000-aa3c-f8362201d73b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.152609 Jun 02 10:18:53.131055 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 298/584] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:52 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:18:53.940523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-e8d1442e-0ef4-4675-a40a-7829e2b371c3 req-fb5a5009-29dc-427e-9dfa-b6fbf70f4892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:53.949572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e8d1442e-0ef4-4675-a40a-7829e2b371c3 req-fb5a5009-29dc-427e-9dfa-b6fbf70f4892 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:53.949957 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-e8d1442e-0ef4-4675-a40a-7829e2b371c3 req-fb5a5009-29dc-427e-9dfa-b6fbf70f4892 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:53.960925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-e8d1442e-0ef4-4675-a40a-7829e2b371c3 req-fb5a5009-29dc-427e-9dfa-b6fbf70f4892 service nova] Creating event network-changed:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:18:53.965948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-e8d1442e-0ef4-4675-a40a-7829e2b371c3 req-fb5a5009-29dc-427e-9dfa-b6fbf70f4892 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087164 Jun 02 10:18:53.966796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 287/585] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:54.148679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:54.149295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:54.156190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:54.156646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:54.157420 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:54.157862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:54.350922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:54.359700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:54.361250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:54.362418 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c3aa77bb-c577-4f51-b9a9-cdf4c27f7d88 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.217628 Jun 02 10:18:54.362977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 299/586] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:54 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:55.382316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:55.383020 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:55.389943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:55.390921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:55.391715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:55.392152 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:55.521517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:55.529891 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:55.532032 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:55.533189 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7ea1a865-e1e0-4d37-9d62-26c929f6a908 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1809 microversion: 2.20 time: 0.155771 Jun 02 10:18:55.533756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 288/587] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:55 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:18:55.980322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-d766bd6d-4e58-4873-ad5a-6f24fde36696 req-b3712bd8-dfbd-4148-a04b-7602e94cede1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:18:55.989183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d766bd6d-4e58-4873-ad5a-6f24fde36696 req-b3712bd8-dfbd-4148-a04b-7602e94cede1 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:55.989630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d766bd6d-4e58-4873-ad5a-6f24fde36696 req-b3712bd8-dfbd-4148-a04b-7602e94cede1 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:56.000638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-d766bd6d-4e58-4873-ad5a-6f24fde36696 req-b3712bd8-dfbd-4148-a04b-7602e94cede1 service nova] Creating event network-changed:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:18:56.005475 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-d766bd6d-4e58-4873-ad5a-6f24fde36696 req-b3712bd8-dfbd-4148-a04b-7602e94cede1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028811 Jun 02 10:18:56.006039 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 300/588] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:18:56.550952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:18:56.551588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:18:56.557911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:56.558356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:56.559138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:18:56.559578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:18:56.691433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:56.699845 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:56.701380 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:18:56.702524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-711172b6-6973-4e19-a4be-feb65bb8f234 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1796 microversion: 2.20 time: 0.155438 Jun 02 10:18:56.704231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 289/589] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:18:56 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:19:17.558469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=27 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:17.559346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=69 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:17.618084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:17.618663 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:17.624732 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.625661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.626409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.626839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.651415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-12cebc54-baeb-4950-966e-fc6f6664e8d6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/ips" status: 200 len: 151 microversion: 2.1 time: 0.094676 Jun 02 10:19:17.651958 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 301/590] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:19:17 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/ips => generated 151 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:17.662603 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:17.663711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:17.666079 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=23 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:17.666870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:17.671520 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.672000 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.672870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.673339 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.752675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: POST /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/os-volume_attachments HTTP/1.1 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 74 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:19:17.754385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {"volumeAttachment": {"volumeId": "00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be"}} Jun 02 10:19:17.755853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'server_id': 'b21e6592-8825-41a5-8feb-04019f190306', 'body': {'volumeAttachment': {'volumeId': '00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be'}}} Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:17.756668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:17.758070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 400 to user: Invalid volume: volume 00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be is already attached to instances: 480d49c3-9724-40e7-a993-e9bf6ee926fb {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-14304ef0-8b2a-49ca-ab3a-45e95dffcf8d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097212 Jun 02 10:19:17.759602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 290/591] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:19:17 2022] POST /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:19:17.764657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:17.765209 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:17.771825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.772279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.773038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:17.773477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:17.797544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:19:18.048026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e86cda72-0c89-4490-b2c2-e86987e5cc67 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 204 len: 0 microversion: 2.1 time: 0.286246 Jun 02 10:19:18.048644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 302/592] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:19:17 2022] DELETE /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 10:19:18.056711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:18.057369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:18.064816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:18.065268 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:18.066075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:18.066519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:18.196401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:18.203835 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-15bd58bb-a4bd-46e1-964e-e3a2734e41f9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1682 microversion: 2.1 time: 0.150906 Jun 02 10:19:18.204396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 291/593] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:18 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:19.221679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:19.222409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:19.228874 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:19.229323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:19.230081 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:19.230518 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:19.360328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:19.367531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1fcfaa64-2f2e-4e6e-9664-5a5f97fc041c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1682 microversion: 2.1 time: 0.150104 Jun 02 10:19:19.368102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 303/594] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:19 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:19.952324 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-675103803"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:19.952921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:19.959453 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:19.959938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:19.960704 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:19.961146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:20.095315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.network.security_group_api [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Removing security group 330f701e-6ecc-4dbc-b915-cb918efec099 from port 6e7f6cd7-2553-4013-b7ea-656e8c9454c6 Jun 02 10:19:20.387638 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:20.388470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:20.394730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:20.395227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:20.395999 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:20.396438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:20.577432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-08d0e593-e8dc-469a-a0b9-23015b0a9900 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action" status: 202 len: 0 microversion: 2.1 time: 0.629042 Jun 02 10:19:20.578952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 292/595] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:19:19 2022] POST /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:20.593096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-4d31cf46-644a-4dd6-ba69-26dcadb2c379 req-d140c71f-9ffa-454a-81e2-a0c7392de55e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:20.615751 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-4d31cf46-644a-4dd6-ba69-26dcadb2c379 req-d140c71f-9ffa-454a-81e2-a0c7392de55e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:20.615751 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-4d31cf46-644a-4dd6-ba69-26dcadb2c379 req-d140c71f-9ffa-454a-81e2-a0c7392de55e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:20.628176 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-4d31cf46-644a-4dd6-ba69-26dcadb2c379 req-d140c71f-9ffa-454a-81e2-a0c7392de55e service nova] Creating event network-changed:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:19:20.638024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:20.647619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-4d31cf46-644a-4dd6-ba69-26dcadb2c379 req-d140c71f-9ffa-454a-81e2-a0c7392de55e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057929 Jun 02 10:19:20.648680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-55cc922c-6426-46ba-9626-628a476366bf tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1682 microversion: 2.1 time: 0.265655 Jun 02 10:19:20.649271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 304/596] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:20 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:20.650194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 293/597] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:21.400551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-6fbe7e8a-ad53-4bf0-9fad-9bfc0b06ca15 req-822ad2b2-7b0f-4cf7-ba7a-ea0979354966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e6592-8825-41a5-8feb-04019f190306", "name": "network-vif-deleted", "tag": "163bd3a3-4afc-49ca-849a-e9533a83c338"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:21.413274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-6fbe7e8a-ad53-4bf0-9fad-9bfc0b06ca15 req-822ad2b2-7b0f-4cf7-ba7a-ea0979354966 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:21.413729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-6fbe7e8a-ad53-4bf0-9fad-9bfc0b06ca15 req-822ad2b2-7b0f-4cf7-ba7a-ea0979354966 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:21.440088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-6fbe7e8a-ad53-4bf0-9fad-9bfc0b06ca15 req-822ad2b2-7b0f-4cf7-ba7a-ea0979354966 service nova] Creating event network-vif-deleted:163bd3a3-4afc-49ca-849a-e9533a83c338 for instance b21e6592-8825-41a5-8feb-04019f190306 on hv-cinder-79760 Jun 02 10:19:21.450485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-6fbe7e8a-ad53-4bf0-9fad-9bfc0b06ca15 req-822ad2b2-7b0f-4cf7-ba7a-ea0979354966 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173587 Jun 02 10:19:21.452989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 294/598] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:21.665886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:21.666492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:21.673923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:21.674665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:21.675642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:21.676241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:21.727890 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:21.728471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:21.728989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'fault' on Instance uuid b21e6592-8825-41a5-8feb-04019f190306 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:19:21.776062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:21.784276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0b1794c-bcf8-4f23-af7d-328e73cbe42e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 200 len: 1331 microversion: 2.1 time: 0.122339 Jun 02 10:19:21.793276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 305/599] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:21 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:22.301910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:22.302858 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:22.310169 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.310977 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.311986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.312626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.466375 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lazy-loading 'services' on Instance uuid a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:19:22.665819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-e56ac5bf-a7e4-416b-b0a6-82272508084e req-c220f68e-655c-4571-bc47-18b72626b206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:22.674048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-e56ac5bf-a7e4-416b-b0a6-82272508084e req-c220f68e-655c-4571-bc47-18b72626b206 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.675408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-e56ac5bf-a7e4-416b-b0a6-82272508084e req-c220f68e-655c-4571-bc47-18b72626b206 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.688187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-e56ac5bf-a7e4-416b-b0a6-82272508084e req-c220f68e-655c-4571-bc47-18b72626b206 service nova] Creating event network-changed:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:19:22.694942 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-e56ac5bf-a7e4-416b-b0a6-82272508084e req-c220f68e-655c-4571-bc47-18b72626b206 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Jun 02 10:19:22.694942 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 306/600] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:22.751626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0fb4d0b2-607a-4d2f-a7e5-bac4a569aaf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments/0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614" status: 202 len: 0 microversion: 2.1 time: 0.454512 Jun 02 10:19:22.752882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 295/601] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:19:22 2022] DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments/0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:22.762438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:22.763519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:22.776827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.777273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.778557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.779005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.803183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:22.803902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:22.822733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.822733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.822733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:22.822733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:22.857653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-15a67913-323c-4031-bafc-6d8c632891a6 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088873 Jun 02 10:19:22.858447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 307/602] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:22 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:22.869847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 HTTP/1.1 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:19:22.873786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:19:22.875559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'b21e6592-8825-41a5-8feb-04019f190306'} Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:19:22.876794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:19:22.878275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:22.879867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:19:22.879867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e003b25a-9f27-48ca-b074-c5b5eb9dd58d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 404 len: 111 microversion: 2.1 time: 0.077442 Jun 02 10:19:22.883979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 296/603] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:22 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 10:19:22.890962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-be962a59-2b55-4c5c-9a41-f88eed7a7ba4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '.version_select at 0x7f49ddda1e50>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:22.998581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-be962a59-2b55-4c5c-9a41-f88eed7a7ba4 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937632763" status: 202 len: 0 microversion: 2.1 time: 0.113461 Jun 02 10:19:22.999804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 308/604] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 2 10:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1937632763 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:23.869939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:23.871609 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:23.879396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:23.880060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:23.881003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:23.881746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:23.916191 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a1864fd5-8d12-4f9b-82f7-f8a933797bf0 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050086 Jun 02 10:19:23.916766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 297/605] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:23 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:23.941749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:23.942300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:23.951904 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:23.952348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:23.953171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:23.953607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.038622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'services' on Instance uuid 480d49c3-9724-40e7-a993-e9bf6ee926fb {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:19:24.282380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1ca88e7d-42a2-4484-9939-52ce80e6a9e7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments/00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be" status: 202 len: 0 microversion: 2.1 time: 0.344660 Jun 02 10:19:24.282977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 309/606] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:19:23 2022] DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments/00f1aadb-a33e-4d3f-b86b-0e20fa0ee8be => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:24.291442 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:24.292377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:24.298497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.298953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.299756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.300200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.330352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b8687c7c-21eb-4be4-a8a5-ab2b84e56f79 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042912 Jun 02 10:19:24.330914 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 298/607] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:24 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:24.929306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:24.930301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:24.936646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.937110 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.937848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.938284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.965582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4e61a9bd-ce62-48b0-9fb7-46e981c4d74c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040659 Jun 02 10:19:24.966202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 310/608] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:24 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:19:24.976417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:24.976919 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:24.983381 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.983838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:24.985345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:24.985787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:25.059882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] HTTP exception thrown: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c is not attached to volume 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Request method failure captured: Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments/0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 HTTP/1.1 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI2b1BiErxvlhApbmmJPCCSCzRHtzgHPF2vVXNZcJmJf0cgg0rKyPU3yApO5EqpIFHCM1_buHIW-c_nOjDVQ7OjVG7uvd4SdWHVxXV1yXipBMCzUzQH3N6ge5hNEE5ZMxFlWW486NRDkcB-SrlwOJml1tgdWz2-uJXFmS1a_t-GD8tw Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 0fe7771afa3e4fb0a3fcfa8f328c1ebb Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:19:25.066119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 0fe7771afa3e4fb0a3fcfa8f328c1ebb Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-TestMinimumBasicScenario-329312920-project Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: f4a690835f9143b096f00fceb47d4a10 Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-TestMinimumBasicScenario-329312920-project Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:19:25.067760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c is not attached to volume 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'server_id': 'a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c', 'id': '0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614'} Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614. Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:19:25.068657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c is not attached to volume 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c is not attached to volume 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:19:25.069805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Returning 404 to user: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c is not attached to volume 0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:19:25.070691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cc4349e4-4de5-42bc-ad3a-35aacbc45f5e tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments/0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614" status: 404 len: 154 microversion: 2.1 time: 0.095283 Jun 02 10:19:25.070691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 299/609] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:19:24 2022] DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c/os-volume_attachments/0b7b0050-9e69-47ad-8eb6-6d7d7bdb4614 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:19:25.341965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:25.342883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:25.349506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:25.349961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:25.350771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:25.351247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:25.380197 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fd8ffde2-5956-4b4d-938a-c4bbd4303985 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 Jun 02 10:19:25.380768 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 311/610] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:25 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:26.313819 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:26.314402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:26.320906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.321353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.322116 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.322554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.346454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:19:26.391769 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:26.392681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:26.399076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.399553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.400356 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.400789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.429585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d6122da8-47b5-483c-bc53-804e53ada5d1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041804 Jun 02 10:19:26.430127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 312/611] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:19:26 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 02 10:19:26.487152 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:26.487654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:26.493894 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.494349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.495155 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.495585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.519884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:19:26.612827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2a5a064a-a4b4-4203-9eac-054caf5e1dc3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 204 len: 0 microversion: 2.1 time: 0.303176 Jun 02 10:19:26.613700 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 300/612] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:19:26 2022] DELETE /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:19:26.622170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:26.622924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:26.628928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.631192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.631192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.631192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.765855 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:26.773502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b823680a-3473-4fed-b985-3bc152ead767 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1553 microversion: 2.1 time: 0.155250 Jun 02 10:19:26.774004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 301/613] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:26 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:19:26.808247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a7f57c7b-d514-46c9-a5cc-24d6afa9a43f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 204 len: 0 microversion: 2.1 time: 0.325265 Jun 02 10:19:26.808863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 313/614] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:19:26 2022] DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 02 10:19:26.817351 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:26.817969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:26.824085 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.824537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.825304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:26.825740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:26.954939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:26.962583 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6b398175-3298-46e0-9e75-e3bf61919ba7 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1680 microversion: 2.1 time: 0.149424 Jun 02 10:19:26.963185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 302/615] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:26 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:19:27.792147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:27.792881 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:27.799588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:27.800027 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:27.800780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:27.801210 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:27.930404 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:27.938048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a2ea722e-82c8-4d1e-8658-f975c2b4d47c tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1553 microversion: 2.1 time: 0.150335 Jun 02 10:19:27.938607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 314/616] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:27 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:27.980560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:27.981177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:27.988631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:27.989086 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:27.989855 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:27.990299 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:28.123434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:28.131118 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-df8382d5-dc59-4426-b7af-b14872336264 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1680 microversion: 2.1 time: 0.154298 Jun 02 10:19:28.131680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 303/617] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:27 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:28.955799 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:28.956346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:28.962690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:28.965190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:28.965190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:28.965190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:28.968512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:29.095743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:29.102976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7498efda-19bb-42d4-af30-ee7fe71ae212 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1553 microversion: 2.1 time: 0.151761 Jun 02 10:19:29.103576 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 315/618] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:28 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:29.148497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:29.149113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:29.155041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:29.155519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:29.156302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:29.156762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:29.295309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:29.305055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4758b76d-225f-48cb-9a0d-fbaa4d2466a5 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1680 microversion: 2.1 time: 0.160422 Jun 02 10:19:29.306199 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 304/619] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:29 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:30.120503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:30.121330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:30.125474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-1d0fe2a4-c888-4d3d-871b-9838261e09db req-8b4c0e4b-5fde-48a0-81d2-3ccf0ebd78d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c", "name": "network-vif-deleted", "tag": "6e7f6cd7-2553-4013-b7ea-656e8c9454c6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:30.129927 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:30.131118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:30.131905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:30.132758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:30.144343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-1d0fe2a4-c888-4d3d-871b-9838261e09db req-8b4c0e4b-5fde-48a0-81d2-3ccf0ebd78d5 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:30.145046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-1d0fe2a4-c888-4d3d-871b-9838261e09db req-8b4c0e4b-5fde-48a0-81d2-3ccf0ebd78d5 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:30.159406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-1d0fe2a4-c888-4d3d-871b-9838261e09db req-8b4c0e4b-5fde-48a0-81d2-3ccf0ebd78d5 service nova] Creating event network-vif-deleted:6e7f6cd7-2553-4013-b7ea-656e8c9454c6 for instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c on hv-cinder-79760 Jun 02 10:19:30.167494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-1d0fe2a4-c888-4d3d-871b-9838261e09db req-8b4c0e4b-5fde-48a0-81d2-3ccf0ebd78d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046790 Jun 02 10:19:30.168573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 305/620] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:30.230291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a690835f9143b096f00fceb47d4a10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fe7771afa3e4fb0a3fcfa8f328c1ebb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:30.238212 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b8cdf1ae-1c88-4a62-bf57-7c13dc0d5859 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 200 len: 1511 microversion: 2.1 time: 0.121291 Jun 02 10:19:30.238813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 316/621] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:30 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:30.330602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:30.331490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:30.350238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:30.350701 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:30.351530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:30.353418 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:30.431415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:30.440401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b81f8297-3a5f-48f0-8d20-4b2b1516db26 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1613 microversion: 2.1 time: 0.114910 Jun 02 10:19:30.449975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 306/622] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:30 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:31.259188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:31.263879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [instance: a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:31.268838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:31.269290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:31.270061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:31.270694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:31.285132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] HTTP exception thrown: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Request method failure captured: Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c HTTP/1.1 Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI2b1BiErxvlhApbmmJPCCSCzRHtzgHPF2vVXNZcJmJf0cgg0rKyPU3yApO5EqpIFHCM1_buHIW-c_nOjDVQ7OjVG7uvd4SdWHVxXV1yXipBMCzUzQH3N6ge5hNEE5ZMxFlWW486NRDkcB-SrlwOJml1tgdWz2-uJXFmS1a_t-GD8tw Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 0fe7771afa3e4fb0a3fcfa8f328c1ebb Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:19:31.286854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0fe7771afa3e4fb0a3fcfa8f328c1ebb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 0fe7771afa3e4fb0a3fcfa8f328c1ebb Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-TestMinimumBasicScenario-329312920 Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-TestMinimumBasicScenario-329312920-project Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: f4a690835f9143b096f00fceb47d4a10 Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-TestMinimumBasicScenario-329312920-project Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. Jun 02 10:19:31.288707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c'} Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:19:31.289635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. Jun 02 10:19:31.291018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:31.292805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Returning 404 to user: Instance a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:19:31.292805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f31f22f6-73fe-4af9-b5f8-322560b6d7a3 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c" status: 404 len: 111 microversion: 2.1 time: 0.036099 Jun 02 10:19:31.292805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 317/623] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:31 2022] GET /compute/v2.1/servers/a7a88b03-6f6d-4e37-9c2f-2afbacc04a6c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:19:31.297733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-52c7022a-4f5d-44c6-a4a4-75596c7ea2d2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] Calling method '.version_select at 0x7f49ddc11ca0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:31.302886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR oslo.messaging._drivers.impl_rabbit [None req-52c7022a-4f5d-44c6-a4a4-75596c7ea2d2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [54c1a088-9dbe-47da-9bf4-ee3b6192c272] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 10:19:31.457597 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:31.458221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:31.468320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:31.468826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:31.469612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:31.470050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:31.504480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:31.505133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:31.505599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'fault' on Instance uuid 480d49c3-9724-40e7-a993-e9bf6ee926fb {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:19:31.548800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:31.556373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-470c087d-ef79-4ab0-8293-ca9f54e4d4ff tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 200 len: 1330 microversion: 2.1 time: 0.102708 Jun 02 10:19:31.556954 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 318/624] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:31 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:19:32.184878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-f53bec42-09e2-475e-b210-50bdd236b38b req-154b1483-a1b5-4047-bb16-7e6a0c40d79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480d49c3-9724-40e7-a993-e9bf6ee926fb", "name": "network-vif-deleted", "tag": "c8e6335f-c5c8-4521-8d81-dd0d93e17834"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:32.193264 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-f53bec42-09e2-475e-b210-50bdd236b38b req-154b1483-a1b5-4047-bb16-7e6a0c40d79b service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:32.193719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-f53bec42-09e2-475e-b210-50bdd236b38b req-154b1483-a1b5-4047-bb16-7e6a0c40d79b service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:32.204771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-f53bec42-09e2-475e-b210-50bdd236b38b req-154b1483-a1b5-4047-bb16-7e6a0c40d79b service nova] Creating event network-vif-deleted:c8e6335f-c5c8-4521-8d81-dd0d93e17834 for instance 480d49c3-9724-40e7-a993-e9bf6ee926fb on hv-cinder-79760 Jun 02 10:19:32.210588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-f53bec42-09e2-475e-b210-50bdd236b38b req-154b1483-a1b5-4047-bb16-7e6a0c40d79b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029366 Jun 02 10:19:32.211232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 319/625] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:32.307684 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [None req-52c7022a-4f5d-44c6-a4a4-75596c7ea2d2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] [54c1a088-9dbe-47da-9bf4-ee3b6192c272] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 49238. Jun 02 10:19:32.386315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-52c7022a-4f5d-44c6-a4a4-75596c7ea2d2 tempest-TestMinimumBasicScenario-329312920 tempest-TestMinimumBasicScenario-329312920-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1144543174" status: 202 len: 0 microversion: 2.1 time: 1.092980 Jun 02 10:19:32.386895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 307/626] 10.222.0.13 () {58 vars in 1271 bytes} [Thu Jun 2 10:19:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1144543174 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:32.574792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:32.578561 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:32.582309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:32.582753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:32.583537 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:32.583970 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:32.597879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb HTTP/1.1 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:19:32.599710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:19:32.601296 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '480d49c3-9724-40e7-a993-e9bf6ee926fb'} Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:19:32.602435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:19:32.603872 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:19:32.605097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:19:32.605097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bc22b194-f82b-4273-8f2b-e6bb19dbe8ef tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 404 len: 111 microversion: 2.1 time: 0.031089 Jun 02 10:19:32.605097 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 320/627] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:32 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:19:32.610237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-81f7994f-773f-4bbe-8e61-dbf6f73e4894 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '.version_select at 0x7f49ddfffb80>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:32.689355 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-81f7994f-773f-4bbe-8e61-dbf6f73e4894 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96939200" status: 202 len: 0 microversion: 2.1 time: 0.082893 Jun 02 10:19:32.689871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 308/628] 10.222.0.13 () {58 vars in 1214 bytes} [Thu Jun 2 10:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96939200 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:19:33.430134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-695b8f00-9265-4667-af03-eb6a844b0500 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: .version_select at 0x7f49ddcc2940>, body: {"keypair": {"name": "tempest-keypair-409590177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/U5GCZLDAxjhAPvTrZ7Qtuzwy9v7K+RQYFlXVQV9i2YR/o3CJzvKxxzm+478O9YgYTFVdT86t7u1tlx3JE0dHHO5QmzvXD9Z5v27gSrUxE1VHDBtY/LWd2bqb4IFwivQ=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:33.444313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-695b8f00-9265-4667-af03-eb6a844b0500 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:19:33.448228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-695b8f00-9265-4667-af03-eb6a844b0500 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:19:33.546541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-695b8f00-9265-4667-af03-eb6a844b0500 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120392 Jun 02 10:19:33.547309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 321/629] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:19:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:35.721906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1311021676", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63a76883-1c17-4c5d-93bd-cf38b26e86c2"}], "security_groups": [{"name": "tempest-securitygroup--1877291613"}], "key_name": "tempest-keypair-409590177", "user_data": "}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:35.833297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] validate_networks() for [('63a76883-1c17-4c5d-93bd-cf38b26e86c2', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:19:36.206057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:19:36.206490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:19:36.206972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:19:36.207419 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:19:36.207847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:19:36.217325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:36.217782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:36.219197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:36.224048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:36.227242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:36.239288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:19:36.243560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:19:36.256528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:19:36.259374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:19:36.428096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ae0a5bf9-0892-4b7a-84f5-9e64f1526d04 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.710983 Jun 02 10:19:36.428761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 309/630] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:19:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:19:36.439528 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a4163d0d-9b3b-4354-8d91-61e992c09cd2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:36.440221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a4163d0d-9b3b-4354-8d91-61e992c09cd2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:36.502089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a4163d0d-9b3b-4354-8d91-61e992c09cd2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:36.511235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a4163d0d-9b3b-4354-8d91-61e992c09cd2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1241 microversion: 2.1 time: 0.076009 Jun 02 10:19:36.512190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 322/631] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:36 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:37.529195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:37.529791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:37.536115 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:37.536565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:37.537329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:37.537773 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:37.598441 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:37.605932 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-87dbef00-50ac-449b-90d3-4f7bd9499231 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1245 microversion: 2.1 time: 0.081535 Jun 02 10:19:37.606505 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 310/632] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:37 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:38.625202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:38.625853 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:38.641923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:38.642390 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:38.643236 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:38.643681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:38.904617 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:38.912166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9a3da80b-8ac7-48d1-bcf7-0cb00c932c77 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1311 microversion: 2.1 time: 0.292046 Jun 02 10:19:38.912734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 323/633] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:38 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:39.929955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:39.930519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:39.937522 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:39.938022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:39.938802 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:39.939264 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:40.162180 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:40.172254 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-72421ad6-46fb-42f2-90b8-9082c5df2c06 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.246232 Jun 02 10:19:40.183176 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 311/634] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:39 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:40.686213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-1945c7e6-fe8a-4db2-b577-881f63c6416d req-f8fc07b3-37d0-4ea4-80a8-992fb8df7dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d81486-ec35-4e30-914c-9c54e61ca205", "tag": "ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:40.695392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-1945c7e6-fe8a-4db2-b577-881f63c6416d req-f8fc07b3-37d0-4ea4-80a8-992fb8df7dee service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:40.696343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-1945c7e6-fe8a-4db2-b577-881f63c6416d req-f8fc07b3-37d0-4ea4-80a8-992fb8df7dee service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:40.713917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-1945c7e6-fe8a-4db2-b577-881f63c6416d req-f8fc07b3-37d0-4ea4-80a8-992fb8df7dee service nova] Creating event network-changed:ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c for instance c9d81486-ec35-4e30-914c-9c54e61ca205 on hv-cinder-79760 Jun 02 10:19:40.719342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-1945c7e6-fe8a-4db2-b577-881f63c6416d req-f8fc07b3-37d0-4ea4-80a8-992fb8df7dee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036793 Jun 02 10:19:40.719938 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 324/635] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:41.191491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:41.192090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:41.198876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:41.199726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:41.201022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:41.201654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:41.344776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:41.352148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4a9c6b8f-b9a8-4555-8c29-7964436a61f1 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.165398 Jun 02 10:19:41.359434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 312/636] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:41 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:42.370697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:42.371427 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:42.377688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:42.378144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:42.378913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:42.379376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:42.553896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:42.561511 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-235d2a96-4f9d-4de5-9754-81d4d38e3ca6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.195569 Jun 02 10:19:42.562081 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 325/637] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:42 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:43.578555 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:43.579197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:43.585655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:43.586111 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:43.586934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:43.587417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:43.722939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:43.730395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cb4b57cb-80f7-484d-8465-5dcee9026522 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.155739 Jun 02 10:19:43.730956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 313/638] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:43 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:44.748441 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:44.748978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:44.755568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:44.756018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:44.756814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:44.757254 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:44.883072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:44.890954 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-73824630-b84c-46f8-be4c-46b7fdeec4fa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.146600 Jun 02 10:19:44.891543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 326/639] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:44 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:45.908379 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:45.908997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:45.915516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:45.915973 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:45.916735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:45.917174 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:46.043437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:46.050864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-efb5001e-50cc-408e-a33e-8e7e704e9059 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.146996 Jun 02 10:19:46.051461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 314/640] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:45 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:46.447381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-eaff7855-e43e-45b0-90b4-617f853735a1 req-768fe76e-c1a2-4568-a2a6-6d9653d96645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d81486-ec35-4e30-914c-9c54e61ca205", "name": "network-vif-plugged", "status": "completed", "tag": "ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:46.455889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-eaff7855-e43e-45b0-90b4-617f853735a1 req-768fe76e-c1a2-4568-a2a6-6d9653d96645 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:46.456338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-eaff7855-e43e-45b0-90b4-617f853735a1 req-768fe76e-c1a2-4568-a2a6-6d9653d96645 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:46.466801 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-eaff7855-e43e-45b0-90b4-617f853735a1 req-768fe76e-c1a2-4568-a2a6-6d9653d96645 service nova] Creating event network-vif-plugged:ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c for instance c9d81486-ec35-4e30-914c-9c54e61ca205 on hv-cinder-79760 Jun 02 10:19:46.471890 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-eaff7855-e43e-45b0-90b4-617f853735a1 req-768fe76e-c1a2-4568-a2a6-6d9653d96645 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028211 Jun 02 10:19:46.472438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 327/641] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:19:47.067608 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:47.068264 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:47.070057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:47.070717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:47.076264 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:47.077232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:47.078092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:47.078587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:47.211191 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:47.219288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1d96315a-5230-4bfc-a198-05649207006d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.155479 Jun 02 10:19:47.219846 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 315/642] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:47 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:48.233887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:48.238759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:48.239489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:48.241283 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:48.246330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:48.246789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:48.247586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:48.248034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:48.381490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:48.388796 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-28959b59-e449-44c0-aef6-b973295cae34 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1367 microversion: 2.1 time: 0.156496 Jun 02 10:19:48.389355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 328/643] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:48 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:49.405881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:49.406430 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:49.408790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:49.413551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:49.414002 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:49.414770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:49.415247 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:49.546926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:19:49.554859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5b7968e0-06dc-42ad-967e-8a834cc169b0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1557 microversion: 2.1 time: 0.152916 Jun 02 10:19:49.555525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 316/644] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:19:49 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:19:49.573774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:19:49.574308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:19:49.580912 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:49.581368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:49.582342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:49.582952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:49.662588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-92194bbb-2d60-4744-ae63-a749c0c9dbbe tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094439 Jun 02 10:19:49.663206 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 329/645] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:19:49 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:19:49.779406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:19:49.779619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:19:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:19:50.593063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-746ddc9d-9d36-4900-be50-b1679a1984f1 req-e24236bb-5100-4ae3-9726-c972de605cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d81486-ec35-4e30-914c-9c54e61ca205", "tag": "ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:19:50.602696 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-746ddc9d-9d36-4900-be50-b1679a1984f1 req-e24236bb-5100-4ae3-9726-c972de605cc8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:19:50.603170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-746ddc9d-9d36-4900-be50-b1679a1984f1 req-e24236bb-5100-4ae3-9726-c972de605cc8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:19:50.614668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-746ddc9d-9d36-4900-be50-b1679a1984f1 req-e24236bb-5100-4ae3-9726-c972de605cc8 service nova] Creating event network-changed:ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c for instance c9d81486-ec35-4e30-914c-9c54e61ca205 on hv-cinder-79760 Jun 02 10:19:50.619814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-746ddc9d-9d36-4900-be50-b1679a1984f1 req-e24236bb-5100-4ae3-9726-c972de605cc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030847 Jun 02 10:19:50.620411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 317/646] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:00.474383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.475519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=56 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.481314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:00.482150 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:00.491328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:00.520186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:00.520186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:00.520186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:00.581317 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'services' on Instance uuid ff7d784a-1d47-43a3-b903-4321aa0bf0fe {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:00.812774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d7b1938d-d7b9-4e19-ad47-ee0a908f7c69 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments/aab92970-cc1d-4ecd-9036-f80b482fc060" status: 202 len: 0 microversion: 2.1 time: 0.340212 Jun 02 10:20:00.813362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 330/647] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:20:00 2022] DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments/aab92970-cc1d-4ecd-9036-f80b482fc060 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:20:00.819694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.820499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=44 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.824763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:00.825775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:00.832561 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:00.833691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:00.833691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:00.834077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:00.864319 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4ef4413b-2105-4fc8-ad08-478fcc6abdb7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046225 Jun 02 10:20:00.864868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 318/648] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:20:00 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:01.877569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:01.882317 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:01.884932 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:01.885383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:01.886162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:01.886587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:01.915144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6916a04f-9dfc-4d5d-b732-54bfeda1b301 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Jun 02 10:20:01.915607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 331/649] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:20:01 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:02.926549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:02.927429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:02.934665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:02.935135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:02.935897 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:02.936365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:02.964458 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f90be52e-8132-45e2-8d18-aa77579a6b9f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041976 Jun 02 10:20:02.965004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 319/650] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:20:02 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:20:03.038053 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:03.038570 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:03.044945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.045400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.046221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.046665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.071259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:20:03.331989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ba4bfd2c-990d-4e05-9214-bfef53e073df tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 204 len: 0 microversion: 2.1 time: 0.297485 Jun 02 10:20:03.332580 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 332/651] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:20:03 2022] DELETE /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:20:03.340748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:03.341352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:03.347515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.347963 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.348711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.349145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.482752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:03.490944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dcdeefa1-44b9-43aa-9d03-a2349dd4996e tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.154196 Jun 02 10:20:03.491551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 320/652] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:03 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:03.931122 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:03.931706 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:03.937730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.938183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.938947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:03.939416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:03.963496 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:20:04.293265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a9a2b777-5481-4074-a389-12663cb83595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 204 len: 0 microversion: 2.1 time: 0.366064 Jun 02 10:20:04.294619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 333/653] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:20:03 2022] DELETE /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:20:04.304902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:04.304902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:04.309801 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.310253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.311023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.316582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:04.317149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.317315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:04.323315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.323766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.324572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.325178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.356533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ba13e746-0d3d-420a-bf44-0a527c8b6f95 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments/6c27ffc4-e49e-4965-9bf5-5a526013e948" status: 200 len: 194 microversion: 2.20 time: 0.266582 Jun 02 10:20:04.357092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 321/654] 10.222.0.13 () {60 vars in 1453 bytes} [Thu Jun 2 10:20:04 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments/6c27ffc4-e49e-4965-9bf5-5a526013e948 => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:20:04.420904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:04.421829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:04.427613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.428071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.428845 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.429285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.455484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:04.464182 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3bc6e6f2-550d-4653-a6a9-67e217d1b03a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1578 microversion: 2.1 time: 0.165338 Jun 02 10:20:04.464913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 334/655] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:04 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:04.507260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lazy-loading 'services' on Instance uuid a1c797f6-e7bc-4bbb-8553-cb14810886e3 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:04.508352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:04.508949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:04.515520 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.515979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.516740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.517175 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.645770 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:04.653253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ad54d206-cb28-4e9c-bef4-7245777a8d99 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.148709 Jun 02 10:20:04.653808 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 335/656] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:04 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:04.731752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-091e464c-4e4b-42f8-bf81-7449ae22bb27 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments/6c27ffc4-e49e-4965-9bf5-5a526013e948" status: 202 len: 0 microversion: 2.20 time: 0.314703 Jun 02 10:20:04.732346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 322/657] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 2 10:20:04 2022] DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments/6c27ffc4-e49e-4965-9bf5-5a526013e948 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 02 10:20:04.741178 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:04.741712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:04.747737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.748189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.748964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:04.749889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:04.780765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c778c7fc-8d0b-41b7-a1d6-ed660bfab7d7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044182 Jun 02 10:20:04.781312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 336/658] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:04 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:20:05.483220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:05.484452 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:05.490964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.491450 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.492212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.492653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.620834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:05.628393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-88eacadc-0827-4f51-87fe-fea9139d94b3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1578 microversion: 2.1 time: 0.149890 Jun 02 10:20:05.628965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 323/659] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:05 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:05.669550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:05.670155 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:05.677000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.677443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.678188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.678619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.792326 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:05.793334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:05.799334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.799791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.800564 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:05.801070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:05.803666 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:05.810977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c9485011-ba48-4b4f-8cb7-925d508fd269 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.145269 Jun 02 10:20:05.811820 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 337/660] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:05 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:05.829994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a184814a-d642-43d0-bf73-661f57968933 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041601 Jun 02 10:20:05.830540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 324/661] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:05 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:20:06.645348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:06.645965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:06.652157 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.652599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.653371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.653838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.781634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:06.789270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-998bd840-8296-45f8-b777-878c1f9330a7 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1578 microversion: 2.1 time: 0.147865 Jun 02 10:20:06.789836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 338/662] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:06 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:06.827844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:06.828388 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:06.834836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.835323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.836155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.836523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.841382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:06.856974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:06.856974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.856974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.856974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:06.857401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:06.880218 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-be52b581-c43a-4cc8-974e-43e1b263b6ff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042725 Jun 02 10:20:06.880784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 339/663] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:06 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:20:06.964406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:06.972430 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4dd970b8-3b6b-4480-be3b-e2f92bce09d9 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.148483 Jun 02 10:20:06.973003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 325/664] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:06 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:07.805637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:07.806253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:07.812645 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.813582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:07.814346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.814787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:07.892216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:07.893225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:07.900088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.900545 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:07.901318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.902004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:07.932239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-81cdf1b2-b789-4461-8828-afc858119b72 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044643 Jun 02 10:20:07.932952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 326/665] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:07 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 02 10:20:07.949835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:07.957840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2236aaf5-2063-4620-ac51-72713977c295 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1578 microversion: 2.1 time: 0.156101 Jun 02 10:20:07.958391 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 340/666] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:07 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:07.989628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:07.990234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:07.996117 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.996565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:07.997322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:07.997758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:08.127059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:08.134539 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1fe7e876-09de-4c78-a8fc-93450b7de7e1 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.148922 Jun 02 10:20:08.135133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 327/667] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:07 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:08.946092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:08.947203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:08.956077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:08.956613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:08.957285 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:08.957721 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:08.978337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:08.980952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:08.987990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:08.988526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:08.989370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:08.989476 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3ac9b441-9aa7-4083-bc41-9f8bb27ae544 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049628 Jun 02 10:20:08.989907 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:08.990036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 341/668] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:08 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:20:09.152510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:09.153478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:09.159882 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:09.160478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:09.161384 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:09.161887 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:09.185667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:09.291159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:09.300245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a2620b3e-1e88-4b0c-ae56-5dce8498e120 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1578 microversion: 2.1 time: 0.328863 Jun 02 10:20:09.301303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 328/669] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:08 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1578 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:09.449551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:09.457721 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-09e8158e-06f6-4f2d-a0d0-1752c1d19f31 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1688 microversion: 2.1 time: 0.310042 Jun 02 10:20:09.460936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 342/670] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:09 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1688 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:09.835872 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-1b6efe1c-d5a0-4684-aa2d-06e965557f9c req-77f69d3c-6828-4b1e-b71c-b36411e319c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "344510b0-0870-4e81-bd36-06531d08f864", "name": "network-vif-deleted", "tag": "8f738bf2-f49b-4284-9052-c624f770e61f"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:09.850687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-1b6efe1c-d5a0-4684-aa2d-06e965557f9c req-77f69d3c-6828-4b1e-b71c-b36411e319c8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:09.851157 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-1b6efe1c-d5a0-4684-aa2d-06e965557f9c req-77f69d3c-6828-4b1e-b71c-b36411e319c8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:09.869890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-1b6efe1c-d5a0-4684-aa2d-06e965557f9c req-77f69d3c-6828-4b1e-b71c-b36411e319c8 service nova] Creating event network-vif-deleted:8f738bf2-f49b-4284-9052-c624f770e61f for instance 344510b0-0870-4e81-bd36-06531d08f864 on hv-cinder-79760 Jun 02 10:20:09.869890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-1b6efe1c-d5a0-4684-aa2d-06e965557f9c req-77f69d3c-6828-4b1e-b71c-b36411e319c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 Jun 02 10:20:09.871313 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 329/671] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:09.961171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-37d295c6-8473-4d19-9e58-837e407f86ea req-cf997b89-e53e-43f6-b6bb-3d539ef72c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff7d784a-1d47-43a3-b903-4321aa0bf0fe", "name": "network-vif-deleted", "tag": "bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:09.972318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-37d295c6-8473-4d19-9e58-837e407f86ea req-cf997b89-e53e-43f6-b6bb-3d539ef72c6d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:09.973393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-37d295c6-8473-4d19-9e58-837e407f86ea req-cf997b89-e53e-43f6-b6bb-3d539ef72c6d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:09.987614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-37d295c6-8473-4d19-9e58-837e407f86ea req-cf997b89-e53e-43f6-b6bb-3d539ef72c6d service nova] Creating event network-vif-deleted:bfa7b6da-6b6e-4cc3-9a6d-40fda6c7b57f for instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe on hv-cinder-79760 Jun 02 10:20:09.993170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-37d295c6-8473-4d19-9e58-837e407f86ea req-cf997b89-e53e-43f6-b6bb-3d539ef72c6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035513 Jun 02 10:20:10.003666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:10.005269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:10.009320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 343/672] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:10.023227 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.023689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.024484 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.041410 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.119500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-19035dbc-0d6d-4d4f-8d36-f42f428ed044 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.121517 Jun 02 10:20:10.125827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 330/673] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:20:09 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:10.221680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:10.223367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:10.232930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.237546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.237546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.237546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.280797 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:20:10.317091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:10.317731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:10.330193 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.330665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.331547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.332060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.421167 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:10.429558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f61c35df-3e02-403f-90f7-8fd1bf0ace4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1226 microversion: 2.1 time: 0.116737 Jun 02 10:20:10.431454 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 331/674] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:10 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:10.474349 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:10.475291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:10.481716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.482176 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.482964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.483438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.518752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.519236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.519863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'fault' on Instance uuid ff7d784a-1d47-43a3-b903-4321aa0bf0fe {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:10.564732 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:10.572739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2d60bf30-2cba-42a5-8507-767691adb5b7 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1335 microversion: 2.1 time: 0.102230 Jun 02 10:20:10.573448 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 332/675] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:10 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:10.705462 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b9d35c91-91e5-4195-b10d-152c4987bba1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 204 len: 0 microversion: 2.20 time: 0.493205 Jun 02 10:20:10.710256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 344/676] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 2 10:20:10 2022] DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 10:20:10.714985 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:10.715630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:10.721769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.722220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.722994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:10.723453 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:10.874644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:10.884397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:10.886039 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:10.887369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-13ab2687-27c8-46a9-9cae-dd56eaf47fa7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.176336 Jun 02 10:20:10.893737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 333/677] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:10 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:11.446166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:11.446860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:11.453287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.453904 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.454658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.455107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.485688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.486130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.486569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lazy-loading 'fault' on Instance uuid 344510b0-0870-4e81-bd36-06531d08f864 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:11.527419 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:11.535409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-808afd28-d70e-4b4d-bb51-369d2a05b5d3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1231 microversion: 2.1 time: 0.093420 Jun 02 10:20:11.535965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 345/678] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:11 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:11.593241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:11.594358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:11.600872 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.601326 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.602093 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.602536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.606478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:11.632862 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.633313 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.633763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'fault' on Instance uuid ff7d784a-1d47-43a3-b903-4321aa0bf0fe {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:11.674201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:11.681474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-96d20902-39e2-4d0d-b9dc-0e6027a7b169 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1335 microversion: 2.1 time: 0.092142 Jun 02 10:20:11.682033 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 334/679] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:11 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1335 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:11.908451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:11.909071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:11.915750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.916200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:11.916958 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:11.917385 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.042502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:12.050315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:12.051852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:12.052991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-585504a3-433e-43c9-b353-dd3fb4a034e8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.149559 Jun 02 10:20:12.053544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 346/680] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:11 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:12.552472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:12.553156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:12.559583 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.560033 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.560796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.561271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.591177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.591636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.592084 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lazy-loading 'fault' on Instance uuid 344510b0-0870-4e81-bd36-06531d08f864 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:12.637398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:12.645361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-52a9ee31-ec7f-4016-b9a3-b9c6e7b37f1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 200 len: 1231 microversion: 2.1 time: 0.096688 Jun 02 10:20:12.645925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 335/681] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:12 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:12.700063 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:12.700836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:12.708003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.708574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.709449 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.710125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.742797 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:12.743382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:12.743905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'fault' on Instance uuid ff7d784a-1d47-43a3-b903-4321aa0bf0fe {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:12.809176 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:12.817947 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a231f879-0c80-4e5c-85f6-4be37dad3c20 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 200 len: 1335 microversion: 2.1 time: 0.123505 Jun 02 10:20:12.818876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 347/682] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:12 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:13.071313 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:13.071839 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:13.077954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.078575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.079394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.079835 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.212626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:13.221042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:13.222536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:13.223733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-be103afc-f70a-4647-836c-705d0c90cfff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1724 microversion: 2.20 time: 0.156582 Jun 02 10:20:13.224280 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 336/683] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:13 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:13.580977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-fa23563d-64db-4a4f-8c73-2668cd860113 req-39e928ad-fbfd-4dbc-84a8-4fc494f2945d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1c797f6-e7bc-4bbb-8553-cb14810886e3", "name": "network-vif-deleted", "tag": "0d617641-ecb7-44a7-9070-ef3cac4f18bb"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:13.594631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fa23563d-64db-4a4f-8c73-2668cd860113 req-39e928ad-fbfd-4dbc-84a8-4fc494f2945d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.594631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fa23563d-64db-4a4f-8c73-2668cd860113 req-39e928ad-fbfd-4dbc-84a8-4fc494f2945d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.601665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-fa23563d-64db-4a4f-8c73-2668cd860113 req-39e928ad-fbfd-4dbc-84a8-4fc494f2945d service nova] Creating event network-vif-deleted:0d617641-ecb7-44a7-9070-ef3cac4f18bb for instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 on hv-cinder-79760 Jun 02 10:20:13.606710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-fa23563d-64db-4a4f-8c73-2668cd860113 req-39e928ad-fbfd-4dbc-84a8-4fc494f2945d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 Jun 02 10:20:13.607397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 348/684] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:13.663637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:13.663637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:13.668963 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.669420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.670208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.670695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.689884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] HTTP exception thrown: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Request method failure captured: Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 HTTP/1.1 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI3z3e0AK00UUyuXC1EH5VLdaBMpC7XU91XonTHi9s0DbJnLTWXX8rYNfHXDqquIixOdKA44eGH0gwPA9v-xyt1PvJkiN8bS4SXFzumnxrNo_00QKJvjHULLW-hNCdzJuVJaVLweOhWHq0RVYzh6RHcQMN8G35FvO3uMZK8eJQcZuLo Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:20:13.693743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 722fc8b42ea941499a56937ce0d8ad3a Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:20:13.695648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '344510b0-0870-4e81-bd36-06531d08f864'} Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:20:13.696549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:20:13.697796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.699955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Returning 404 to user: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:20:13.699955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e4ec1d46-413b-445f-931f-2ec6ec254bf9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 404 len: 111 microversion: 2.1 time: 0.035097 Jun 02 10:20:13.699955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 337/685] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:13 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:20:13.805267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1211330412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204552918", "security_groups": [{"name": "tempest-secgroup-smoke-1262281755"}], "block_device_mapping_v2": [{"uuid": "d33d0f91-3544-40ec-bd53-7d08d346feae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49c7bda1-edb9-41b1-8d14-2f7579277ee0"}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:13.844377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:13.844377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: ff7d784a-1d47-43a3-b903-4321aa0bf0fe] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:13.844377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.844377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.844848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:13.844848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:13.860234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] HTTP exception thrown: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Request method failure captured: Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe HTTP/1.1 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI0yUcoLXNG5MwP88pRdB-RsNCsaqrBtpgJ4EDDQKANbI2D6qJtW3oC0t8EUTCqzNTTZUqRm81WxOLdkAonuHyrgy7MdSLj9QeWh8ZqGHfZYAvPvdJ6WbD4dUzMymhSkYDo4-MI99qAj50EcP-VBKb1z1Wy6iT-HvRwcM0H48PLE5WQ Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:20:13.862091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: a696d00855ef439c9d80b6bec5312f20 Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. Jun 02 10:20:13.863723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'ff7d784a-1d47-43a3-b903-4321aa0bf0fe'} Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:20:13.864619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. Jun 02 10:20:13.866081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:13.867424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Returning 404 to user: Instance ff7d784a-1d47-43a3-b903-4321aa0bf0fe could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:20:13.867424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8f2b0e79-7790-47bd-846e-b986ae26466f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe" status: 404 len: 111 microversion: 2.1 time: 0.035056 Jun 02 10:20:13.870830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 338/686] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:13 2022] GET /compute/v2.1/servers/ff7d784a-1d47-43a3-b903-4321aa0bf0fe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 10:20:13.877358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a405f1ae-01c7-444b-85c1-fa808f295475 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '.version_select at 0x7f49ddc3cb80>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:13.940263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] validate_networks() for [('49c7bda1-edb9-41b1-8d14-2f7579277ee0', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:20:13.968155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a405f1ae-01c7-444b-85c1-fa808f295475 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038190263" status: 202 len: 0 microversion: 2.1 time: 0.095530 Jun 02 10:20:13.968942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 339/687] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 2 10:20:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038190263 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 10:20:14.246876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:14.257716 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:14.269785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:14.270633 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:14.271637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:14.272304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:14.485333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:14.486043 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:14.487013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lazy-loading 'fault' on Instance uuid a1c797f6-e7bc-4bbb-8553-cb14810886e3 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:14.535320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:14.544760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:14.546589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:14.548502 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8c08ac66-4a96-431b-9da5-574d4adc9b85 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 200 len: 1372 microversion: 2.20 time: 0.310571 Jun 02 10:20:14.549318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 340/688] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:14 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:14.905161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:20:14.905657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:20:14.906090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:20:14.907186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:20:14.907611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:20:14.921848 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:14.922310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:14.923235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:14.923680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:14.946374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:20:14.952115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for user 722fc8b42ea941499a56937ce0d8ad3a and project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:20:15.012614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:20:15.014816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d33d0f91-3544-40ec-bd53-7d08d346feae',volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:20:15.421791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f9cff248-c258-444e-b26f-940df292c736 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.621411 Jun 02 10:20:15.422443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 349/689] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:20:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:20:15.432479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-889de47f-43ec-4e6c-b4eb-070625eacb4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:15.433640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-889de47f-43ec-4e6c-b4eb-070625eacb4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:15.488483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-889de47f-43ec-4e6c-b4eb-070625eacb4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:15.495447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-889de47f-43ec-4e6c-b4eb-070625eacb4f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1095 microversion: 2.1 time: 0.066622 Jun 02 10:20:15.496098 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 341/690] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:15 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:15.567468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:15.568080 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:15.574556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:15.575000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:15.575783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:15.576215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:15.589261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 HTTP/1.1 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:20:15.590897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:20:15.592542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'a1c797f6-e7bc-4bbb-8553-cb14810886e3'} Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:20:15.593346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:20:15.594756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:20:15.596087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:20:15.596087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-14a468ed-b8f2-4b1a-a9d8-8a7df126cdae tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 404 len: 111 microversion: 2.20 time: 0.028694 Jun 02 10:20:15.596087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 350/691] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:15 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:20:15.601734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a3258804-1ab9-47eb-bd28-6eb61ea9f1ee tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '.version_select at 0x7f49ddc2aaf0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:15.665440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a3258804-1ab9-47eb-bd28-6eb61ea9f1ee tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054603883" status: 204 len: 0 microversion: 2.20 time: 0.067825 Jun 02 10:20:15.666021 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 342/692] 10.222.0.13 () {60 vars in 1261 bytes} [Thu Jun 2 10:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054603883 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 02 10:20:16.446550 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4a2e0420-d5b4-47e9-a432-b2ca82314f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: .version_select at 0x7f49ddca6b80>, body: {"keypair": {"name": "tempest-keypair-76809209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdbk5lT/DjnGU9Pz2YaqOMV7NKrSGvGVGLQPczPaAlg4prY1x3entvfAEi0LoTsVbforvb2QvA8K+pc1xlisJoVcW8EunqPqz41PkSKym2fg69oW3JZ6VVEtu9NTZP2LA=="}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:16.461823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-4a2e0420-d5b4-47e9-a432-b2ca82314f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for project a083c564db474e80af22b7c21af82775. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:20:16.465780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-4a2e0420-d5b4-47e9-a432-b2ca82314f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for user 5a6e44ab0c394541a7d7b290928ea6f8 and project a083c564db474e80af22b7c21af82775. Resources: {'key_pairs'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:20:16.513143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:16.513894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:16.521879 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:16.522273 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:16.523171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:16.523952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:16.574610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4a2e0420-d5b4-47e9-a432-b2ca82314f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.132113 Jun 02 10:20:16.575579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 351/693] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 2 10:20:16 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 02 10:20:16.587362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:16.595126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1abe6c61-0380-425d-aa37-2bee6c084bd6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1137 microversion: 2.1 time: 0.086457 Jun 02 10:20:16.596059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 343/694] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:16 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:17.613087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:17.614728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:17.620741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:17.621342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:17.622030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:17.622470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:17.690020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:17.697566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ff21c815-fb91-4093-a403-4ff08cebc595 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1211 microversion: 2.1 time: 0.089073 Jun 02 10:20:17.701309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 352/695] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:17 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:17.802834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:17.803415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:17.809968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:17.810441 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:17.811584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:17.812210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:17.837744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:20:18.184219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f7199e72-c4cc-4d73-ac08-c8663372ce60 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 204 len: 0 microversion: 2.1 time: 0.386129 Jun 02 10:20:18.185120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 344/696] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:20:17 2022] DELETE /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:20:18.198035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:18.200719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:18.207949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:18.208409 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:18.209251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:18.209693 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:18.399704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:18.418745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-380699c6-ae21-4590-9d3c-10c84866be8f tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1507 microversion: 2.1 time: 0.228610 Jun 02 10:20:18.419581 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 353/697] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:18 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:18.718487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:18.720352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:18.732004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:18.732464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:18.736479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:18.736479 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:19.221980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:19.230905 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a51b5933-b769-463b-acea-dfa52b7b22f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1279 microversion: 2.1 time: 0.518961 Jun 02 10:20:19.231639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 345/698] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:18 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1279 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:19.247992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-92d243ca-9974-4433-9fd8-cd5f098739ed req-3608e219-9fd3-4e47-b8de-6ddd3cd13a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c48663-ab05-403a-b720-7de5695365ec", "tag": "ad59041b-c2bd-453d-a9a4-754ba8f1c306"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:19.274719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-92d243ca-9974-4433-9fd8-cd5f098739ed req-3608e219-9fd3-4e47-b8de-6ddd3cd13a42 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:19.275425 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-92d243ca-9974-4433-9fd8-cd5f098739ed req-3608e219-9fd3-4e47-b8de-6ddd3cd13a42 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:19.294183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-92d243ca-9974-4433-9fd8-cd5f098739ed req-3608e219-9fd3-4e47-b8de-6ddd3cd13a42 service nova] Creating event network-changed:ad59041b-c2bd-453d-a9a4-754ba8f1c306 for instance f7c48663-ab05-403a-b720-7de5695365ec on hv-cinder-79760 Jun 02 10:20:19.299763 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-92d243ca-9974-4433-9fd8-cd5f098739ed req-3608e219-9fd3-4e47-b8de-6ddd3cd13a42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055323 Jun 02 10:20:19.300613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 354/699] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:19.439370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:19.440164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:19.453194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:19.454641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:19.455847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:19.456468 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:19.505530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1371248422", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "446b9881-f742-4d54-8f0d-e0c8e564e2d9"}], "security_groups": [{"name": "tempest-securitygroup--1359468805"}], "key_name": "tempest-keypair-76809209", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:19.513727 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:19.655995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] validate_networks() for [('446b9881-f742-4d54-8f0d-e0c8e564e2d9', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:20:19.693671 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:19.701490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fb97c915-7eea-40bf-b3ab-b2d426809665 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1507 microversion: 2.1 time: 0.268330 Jun 02 10:20:19.702059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 346/700] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:19 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:19.876618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-d5155804-68ff-4ac0-ae74-3a7e4c480b7d req-ab42b537-7cb2-47c4-80c5-895c412935e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018f9347-694c-4dcd-84c1-190b2b829067", "name": "network-vif-deleted", "tag": "7e154b60-05d7-41bf-adef-be1c10a169b0"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:19.885997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d5155804-68ff-4ac0-ae74-3a7e4c480b7d req-ab42b537-7cb2-47c4-80c5-895c412935e8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:19.886706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d5155804-68ff-4ac0-ae74-3a7e4c480b7d req-ab42b537-7cb2-47c4-80c5-895c412935e8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:19.905103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-d5155804-68ff-4ac0-ae74-3a7e4c480b7d req-ab42b537-7cb2-47c4-80c5-895c412935e8 service nova] Creating event network-vif-deleted:7e154b60-05d7-41bf-adef-be1c10a169b0 for instance 018f9347-694c-4dcd-84c1-190b2b829067 on hv-cinder-79760 Jun 02 10:20:19.910404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-d5155804-68ff-4ac0-ae74-3a7e4c480b7d req-ab42b537-7cb2-47c4-80c5-895c412935e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037850 Jun 02 10:20:19.913909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 347/701] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:20.250237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:20.253227 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:20.273196 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.274670 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.275676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.276140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.302549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:20:20.303878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:20:20.304937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:20:20.306151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:20:20.306838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:20:20.323552 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.324367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.325492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.325933 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.344873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for project a083c564db474e80af22b7c21af82775. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:20:20.348826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Getting quotas for user 5a6e44ab0c394541a7d7b290928ea6f8 and project a083c564db474e80af22b7c21af82775. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:20:20.361123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:20:20.363774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:20:20.425941 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:20.433537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f83b4067-ed93-4b61-8394-7e3861a2cb21 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.187746 Jun 02 10:20:20.434103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 348/702] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:20 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:20.500907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-11369eda-b1ba-4416-87be-4a909a3edecb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.000113 Jun 02 10:20:20.501554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 355/703] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 2 10:20:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 02 10:20:20.511985 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:20.512752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:20.580736 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:20.587974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:20.589542 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:20.591180 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f637c1e0-2f2c-4782-9336-ed22e6822340 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1280 microversion: 2.20 time: 0.083430 Jun 02 10:20:20.592146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 349/704] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:20 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:20.718803 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:20.720034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:20.726333 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.726784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.727578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.728020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.758707 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.759181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.759628 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lazy-loading 'fault' on Instance uuid 018f9347-694c-4dcd-84c1-190b2b829067 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:20.801615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:20.808975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-66d6ba65-f922-4007-b86c-205d8f991065 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 200 len: 1311 microversion: 2.1 time: 0.094144 Jun 02 10:20:20.809538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 356/705] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:20 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:20.849684 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:20.850273 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:20.856690 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.857146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.858023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:20.858456 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:20.883244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lazy-loading 'flavor' on Instance uuid 5999b411-b480-47b2-bcf8-5893bf9952ae {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:20:21.221782 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a49e2fe1-e824-4667-b6aa-15d58827d7ca tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "POST /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae/action" status: 202 len: 0 microversion: 2.1 time: 0.375738 Jun 02 10:20:21.222464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 350/706] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:20:20 2022] POST /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:20:21.230738 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:21.231401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:21.237607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.238048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.238804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.239270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.375796 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:21.383279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-efd18815-f2bd-468d-9776-42aeae3b057a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.156418 Jun 02 10:20:21.384434 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 357/707] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:21 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:21.451283 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:21.451989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:21.458849 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.459343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.460113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.460553 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.605474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:21.610513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:21.611160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:21.615301 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-06986515-cd9f-4ac1-a126-7140b5fdba43 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.168509 Jun 02 10:20:21.616069 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 351/708] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:21 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:21.617877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.618334 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.619190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.619648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.687491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:21.695885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:21.697401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:21.698507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e869be84-1c37-421c-8f2e-402f539f8441 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1284 microversion: 2.20 time: 0.092497 Jun 02 10:20:21.699066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 358/709] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:21 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:21.826048 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:21.826663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: 018f9347-694c-4dcd-84c1-190b2b829067] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:21.832652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.833109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.833878 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.834318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.838300 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:21.850137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] HTTP exception thrown: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Request method failure captured: Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 HTTP/1.1 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI0yUcoLXNG5MwP88pRdB-RsNCsaqrBtpgJ4EDDQKANbI2D6qJtW3oC0t8EUTCqzNTTZUqRm81WxOLdkAonuHyrgy7MdSLj9QeWh8ZqGHfZYAvPvdJ6WbD4dUzMymhSkYDo4-MI99qAj50EcP-VBKb1z1Wy6iT-HvRwcM0H48PLE5WQ Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:20:21.851786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: a696d00855ef439c9d80b6bec5312f20 Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. Jun 02 10:20:21.855594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '018f9347-694c-4dcd-84c1-190b2b829067'} Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:20:21.856486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. Jun 02 10:20:21.857987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:21.859377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Returning 404 to user: Instance 018f9347-694c-4dcd-84c1-190b2b829067 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:20:21.859377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-64afe416-e4f4-4fdf-b285-e81428b68d72 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067" status: 404 len: 111 microversion: 2.1 time: 0.031227 Jun 02 10:20:21.859377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 352/710] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:21 2022] GET /compute/v2.1/servers/018f9347-694c-4dcd-84c1-190b2b829067 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:20:21.862600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:21.863139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:21.869173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.869618 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.870374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:21.870809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:21.895323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:20:22.027667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:22.143612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8d86dfce-2095-4d29-a7e3-3426151d50e5 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "DELETE /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 204 len: 0 microversion: 2.1 time: 0.285441 Jun 02 10:20:22.144204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 359/711] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:20:21 2022] DELETE /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:20:22.152524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:22.153134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:22.160474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.160925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.161691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.162138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.296507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.304415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d43b6050-07a7-44d6-a840-2da6ae4c4560 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.156108 Jun 02 10:20:22.304984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 353/712] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:22 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:22.402303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:22.403066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:22.411429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.411873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.412625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.413057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.544395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.551839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5fa4a7d3-5a30-4ccd-b092-1f6bc4898048 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.153826 Jun 02 10:20:22.552412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 360/713] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:22 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:22.633087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:22.633721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:22.639833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.640286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.641045 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.642148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.716451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:22.717211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:22.723230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.723691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.724460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:22.724903 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:22.771854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.779642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4e7c7fab-876f-476c-90f8-1e1b9f364362 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.150778 Jun 02 10:20:22.780210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 354/714] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:22 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:22.788560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.796480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.797928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:22.799028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7dbeaa7a-3f96-415b-a20d-081b6a49296a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1340 microversion: 2.20 time: 0.086555 Jun 02 10:20:22.799608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 361/715] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:22 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:23.321497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:23.322112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:23.328963 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.329415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.330309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.330968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.468999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:23.478015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-340bc1b2-3a45-4825-9e45-cf42cc7e32ac tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1521 microversion: 2.1 time: 0.160341 Jun 02 10:20:23.479128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 355/716] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:23 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:23.568967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:23.569614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:23.576091 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.576751 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.577530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.577973 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.795734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:23.796385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:23.799311 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:23.802735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.803720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.804179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.804625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.937571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:23.941844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:23.946355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c04b00f9-ca19-43f4-b9c9-fa6fcd02e00d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.381208 Jun 02 10:20:23.947190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 362/717] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:23 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:23.949981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-39a962b3-0c97-46ef-bed8-32e0afcde9fe tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.158118 Jun 02 10:20:23.950651 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 356/718] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:23 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:23.952512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:23.953128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:23.959725 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.960187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:23.960961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:23.961400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.051305 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:24.059656 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:24.061199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:24.062268 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5b0af12c-b521-4199-81e0-292cb50973f1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1338 microversion: 2.20 time: 0.113905 Jun 02 10:20:24.062814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 363/719] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:23 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:24.496082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:24.497202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:24.506513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.507238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.508760 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.509642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.611045 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a696d00855ef439c9d80b6bec5312f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86951ec86e2046c3bbba0ba1bc6738e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:24.618237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-4247ab37-8e91-4e10-964d-b5c68d3c4f54 req-205b9df8-1d01-4abd-8903-d96775a3e7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd186230-f6d5-41ad-abf4-ff9671465a29", "name": "network-vif-deleted", "tag": "dc2364a5-75e4-4d94-9213-794f385c71db"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:24.628184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ec547e9c-3adf-4ad1-a77e-e813308f2c47 tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 200 len: 1479 microversion: 2.1 time: 0.135785 Jun 02 10:20:24.630401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-4247ab37-8e91-4e10-964d-b5c68d3c4f54 req-205b9df8-1d01-4abd-8903-d96775a3e7c7 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.631403 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-4247ab37-8e91-4e10-964d-b5c68d3c4f54 req-205b9df8-1d01-4abd-8903-d96775a3e7c7 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.633296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 357/720] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:24 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 1479 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:24.647343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-4247ab37-8e91-4e10-964d-b5c68d3c4f54 req-205b9df8-1d01-4abd-8903-d96775a3e7c7 service nova] Creating event network-vif-deleted:dc2364a5-75e4-4d94-9213-794f385c71db for instance cd186230-f6d5-41ad-abf4-ff9671465a29 on hv-cinder-79760 Jun 02 10:20:24.652919 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-4247ab37-8e91-4e10-964d-b5c68d3c4f54 req-205b9df8-1d01-4abd-8903-d96775a3e7c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046223 Jun 02 10:20:24.653807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 364/721] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:24.964193 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:24.964746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:24.966682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:24.967430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:24.971484 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.975657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.975657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.975657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.975948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.975948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:24.975948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:24.975948 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.114761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:25.123478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-945fa17a-020e-433e-8241-74b6ea37aed1 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.163222 Jun 02 10:20:25.128667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 358/722] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:24 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:25.134469 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:25.135184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:25.142774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:25.143354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.146826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:25.146826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.227966 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:25.237827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a850640c-0b19-4af2-b3d2-1e4eedd3fa0d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.275003 Jun 02 10:20:25.239128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 365/723] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:24 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:25.328224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:25.337256 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:25.338930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:25.340099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-57a3dae5-51ae-4136-a032-5f4466bfbb2d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.210391 Jun 02 10:20:25.340729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 359/724] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:25 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:25.494815 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-1f800db6-f7c1-4c32-9542-ceba746514c1 req-641aa0f0-8834-4a68-8d65-bc54b0082869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:25.508340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-1f800db6-f7c1-4c32-9542-ceba746514c1 req-641aa0f0-8834-4a68-8d65-bc54b0082869 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:25.509103 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-1f800db6-f7c1-4c32-9542-ceba746514c1 req-641aa0f0-8834-4a68-8d65-bc54b0082869 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.520766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-1f800db6-f7c1-4c32-9542-ceba746514c1 req-641aa0f0-8834-4a68-8d65-bc54b0082869 service nova] Creating event network-changed:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:20:25.526799 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-1f800db6-f7c1-4c32-9542-ceba746514c1 req-641aa0f0-8834-4a68-8d65-bc54b0082869 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Jun 02 10:20:25.527439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 366/725] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:25.646706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:25.653133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] [instance: cd186230-f6d5-41ad-abf4-ff9671465a29] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:25.654551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:25.655018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.656051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:25.656501 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:25.671131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] HTTP exception thrown: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Request method failure captured: Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 HTTP/1.1 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI0yUcoLXNG5MwP88pRdB-RsNCsaqrBtpgJ4EDDQKANbI2D6qJtW3oC0t8EUTCqzNTTZUqRm81WxOLdkAonuHyrgy7MdSLj9QeWh8ZqGHfZYAvPvdJ6WbD4dUzMymhSkYDo4-MI99qAj50EcP-VBKb1z1Wy6iT-HvRwcM0H48PLE5WQ Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:20:25.672988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/86951ec86e2046c3bbba0ba1bc6738e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 86951ec86e2046c3bbba0ba1bc6738e2 Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-211657074 Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: a696d00855ef439c9d80b6bec5312f20 Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-ServerRescueNegativeTestJSON-211657074-project Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. Jun 02 10:20:25.674571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'cd186230-f6d5-41ad-abf4-ff9671465a29'} Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:20:25.675476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. Jun 02 10:20:25.676930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:20:25.679547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] Returning 404 to user: Instance cd186230-f6d5-41ad-abf4-ff9671465a29 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:20:25.680421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-126811fd-9dfb-40a3-90c1-9de45bfcce3a tempest-ServerRescueNegativeTestJSON-211657074 tempest-ServerRescueNegativeTestJSON-211657074-project] 10.222.0.13 "GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29" status: 404 len: 111 microversion: 2.1 time: 0.037862 Jun 02 10:20:25.681023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 360/726] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:25 2022] GET /compute/v2.1/servers/cd186230-f6d5-41ad-abf4-ff9671465a29 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:20:26.209575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:26.210513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:26.216851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.217308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.220363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.220363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.256404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:26.257687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:26.270102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.270574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.271405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.271903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.529331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:26.538260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-53f9445f-9dcb-4725-9eeb-805d875ab19d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.286220 Jun 02 10:20:26.538859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 361/727] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:26 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:26.543791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:26.544406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:26.552046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.552506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.553296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:26.553739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:26.622759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:26.630310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1077da8c-0741-48a2-b681-f93d0f62e57c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.425544 Jun 02 10:20:26.630871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 367/728] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:26 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:26.740520 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:26.748452 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:26.749976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:26.751113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d4b6efd7-1316-48af-97be-ced92ba780e1 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.211076 Jun 02 10:20:26.751680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 362/729] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:26 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:27.556043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:27.556776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:27.562858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.563921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.564831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.565284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.647936 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:27.649713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:27.656893 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.657438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.658391 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.659015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.722442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:27.731535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4254199b-e5f4-4777-83b7-f3ea5f33bc9e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.179306 Jun 02 10:20:27.732115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 368/730] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:27 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:27.770160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:27.770775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:27.777245 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.777694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.778660 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:27.779113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:27.919250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:27.931077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:27.933140 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:27.934510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bbdb588d-20e9-49af-ba70-650e01e726f4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.169173 Jun 02 10:20:27.935187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 369/731] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:27 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:27.956156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:27.963953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d1f65486-f2a9-4f36-8637-a5a8b72c116f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.320246 Jun 02 10:20:27.964800 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 363/732] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:27 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:28.748435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:28.751154 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:28.758209 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.758944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:28.760359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.760856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:28.914805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:28.923223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-235b000d-5caa-4ca4-a4b4-285ea92cbe0b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.177981 Jun 02 10:20:28.923951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 370/733] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:28 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:28.952653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:28.953288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:28.959653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.962937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:28.962937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.962937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:28.981776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:28.982640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:28.989703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.991401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:28.991401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:28.991610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:29.146929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:29.155247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b43dae57-d92b-4f9d-a13f-e79613e0a151 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.177328 Jun 02 10:20:29.156071 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 371/734] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:28 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:29.205687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:29.215342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:29.217119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:29.219130 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bcbf7615-6f84-4447-aa1d-5bed18b2881d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.270565 Jun 02 10:20:29.222406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 364/735] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:28 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:29.940720 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:29.941237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:29.947771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:29.948228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:29.948994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:29.949436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.083895 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:30.091479 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-43265b1d-0eae-4ab9-b376-a881db29c514 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.155399 Jun 02 10:20:30.092035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 372/736] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:29 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:30.173147 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:30.173772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:30.180290 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:30.180749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.181546 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:30.181990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.240183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:30.240806 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:30.257143 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:30.257605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.259256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:30.259256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.335787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:30.342018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:30.350278 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-be6970c7-5c43-4d3c-b5be-d4c9f428db5f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.181739 Jun 02 10:20:30.350842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 365/737] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:30 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:30.373346 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=16 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:30.418976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:30.427606 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:30.429146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:30.430406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-966bb98c-bfe7-484b-aa71-c0902116bf54 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.195038 Jun 02 10:20:30.431061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 373/738] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:30 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:30.950063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-8116e874-b633-4f99-8388-1389a95fcfe1 req-9cf6f501-1e1c-4fe3-ba14-25c01a39b658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "name": "network-vif-plugged", "status": "completed", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:30.955745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=4 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:30.960092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8116e874-b633-4f99-8388-1389a95fcfe1 req-9cf6f501-1e1c-4fe3-ba14-25c01a39b658 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:30.960533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8116e874-b633-4f99-8388-1389a95fcfe1 req-9cf6f501-1e1c-4fe3-ba14-25c01a39b658 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:30.972291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-8116e874-b633-4f99-8388-1389a95fcfe1 req-9cf6f501-1e1c-4fe3-ba14-25c01a39b658 service nova] Creating event network-vif-plugged:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:20:30.977183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-8116e874-b633-4f99-8388-1389a95fcfe1 req-9cf6f501-1e1c-4fe3-ba14-25c01a39b658 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jun 02 10:20:30.977769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 366/739] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:31.110994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:31.112077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:31.121422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.122320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.123288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.123914 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.303705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:31.311350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4a0d77de-cceb-44e4-b500-06e5f156a44b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.207286 Jun 02 10:20:31.311917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 374/740] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:31 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:31.369774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:31.370472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:31.377979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.378612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.379339 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.379794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.448318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:31.449213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:31.457434 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.457888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.458668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:31.460086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:31.585820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:31.594934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-214a1eda-29fa-4cf5-8bbb-9423d44626aa tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.228885 Jun 02 10:20:31.594934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 367/741] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:31 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:31.651867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:31.661050 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:31.663273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:31.663823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2e08675f-7697-4744-982e-ed21770fcd62 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.219347 Jun 02 10:20:31.664381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 375/742] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:31 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:32.328848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:32.329559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:32.336437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.336892 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.337700 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.338138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.476053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:32.483538 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c8478b7d-90f9-4bb4-83a4-ac3e2ec18161 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.158597 Jun 02 10:20:32.484100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 368/743] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:32 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:32.611578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:32.612185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:32.618756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.619291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.620282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.620719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.682004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:32.682619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:32.690737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.691488 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.692694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:32.693303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:32.774977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:32.783062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f39d7b47-916b-4a88-8115-7984f0d1fe1d tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.175487 Jun 02 10:20:32.783888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 376/744] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:32 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:32.993221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-808b771d-4321-4a63-9474-578b6b6edde2 req-15e7ac87-0d3f-40ad-83c7-67cbe65f34cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c48663-ab05-403a-b720-7de5695365ec", "name": "network-vif-plugged", "status": "completed", "tag": "ad59041b-c2bd-453d-a9a4-754ba8f1c306"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:33.002542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-808b771d-4321-4a63-9474-578b6b6edde2 req-15e7ac87-0d3f-40ad-83c7-67cbe65f34cb service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:33.002986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-808b771d-4321-4a63-9474-578b6b6edde2 req-15e7ac87-0d3f-40ad-83c7-67cbe65f34cb service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:33.014011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-808b771d-4321-4a63-9474-578b6b6edde2 req-15e7ac87-0d3f-40ad-83c7-67cbe65f34cb service nova] Creating event network-vif-plugged:ad59041b-c2bd-453d-a9a4-754ba8f1c306 for instance f7c48663-ab05-403a-b720-7de5695365ec on hv-cinder-79760 Jun 02 10:20:33.019156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-808b771d-4321-4a63-9474-578b6b6edde2 req-15e7ac87-0d3f-40ad-83c7-67cbe65f34cb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029512 Jun 02 10:20:33.019780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 377/745] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:33.164393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:33.173366 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:33.174889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:33.176037 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cf3828fc-7875-4a93-86b1-baf8d8a9e62c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1406 microversion: 2.20 time: 0.497947 Jun 02 10:20:33.176588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 369/746] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:32 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:20:33.500957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:33.501767 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:33.508823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:33.509286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:33.510059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:33.510502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:33.529099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:33.647789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:33.656306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a4931057-85f7-488b-86f4-0eba8b9a9ce1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.159573 Jun 02 10:20:33.657438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 378/747] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:33 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:33.800795 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:33.801421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:33.807979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:33.808568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:33.809455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:33.809827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.062260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:34.066791 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:34.071304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b4bd4d9f-cec6-44a6-82e0-78e4a56a8a27 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.274496 Jun 02 10:20:34.072361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 370/748] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:33 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:34.194915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:34.195615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:34.202360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.208456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.208456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.208456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.349064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:34.371297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:34.377340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:34.378840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-94a666b9-e517-41bb-8617-b95e57edf1bc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1598 microversion: 2.20 time: 0.188252 Jun 02 10:20:34.379640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 379/749] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:20:34 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:20:34.396915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:34.397413 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:34.405133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.405836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.406654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.407285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.587966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-21579aee-71bd-4166-827a-8f785ddf8368 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.194696 Jun 02 10:20:34.588510 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 371/750] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 2 10:20:34 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:20:34.674425 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:34.675051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:34.682307 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.683057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.683883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:34.684327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:34.943928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:34.951402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8d08cc98-f28e-4636-883e-9952f3f277ea tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.281407 Jun 02 10:20:34.952266 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 380/751] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:34 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:35.090658 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:35.092291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:35.101990 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:35.103014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:35.104293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:35.104970 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:35.398013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:35.406745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d48eb1c2-a566-4884-a81e-fd93c5af6952 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.321265 Jun 02 10:20:35.416551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 372/752] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:35 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:35.836323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-30e9c5ef-5692-4b70-9776-e82cf4a3d0f9 req-4792d723-0ba1-4e77-8d8f-90ad1637b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:35.847179 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-30e9c5ef-5692-4b70-9776-e82cf4a3d0f9 req-4792d723-0ba1-4e77-8d8f-90ad1637b1fa service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:35.847983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-30e9c5ef-5692-4b70-9776-e82cf4a3d0f9 req-4792d723-0ba1-4e77-8d8f-90ad1637b1fa service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:35.860867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-30e9c5ef-5692-4b70-9776-e82cf4a3d0f9 req-4792d723-0ba1-4e77-8d8f-90ad1637b1fa service nova] Creating event network-changed:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:20:35.868712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-30e9c5ef-5692-4b70-9776-e82cf4a3d0f9 req-4792d723-0ba1-4e77-8d8f-90ad1637b1fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037344 Jun 02 10:20:35.869904 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 381/753] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:35.972257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:35.974222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:35.992482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:35.992939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:35.993758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:35.994381 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:36.154933 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:36.163560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-52e758e6-871a-4f82-9da0-4d2eaf455eab tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1267 microversion: 2.1 time: 0.197197 Jun 02 10:20:36.164734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 373/754] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:35 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:36.426069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:36.427126 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:36.441562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:36.442286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:36.443332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:36.444314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:36.748070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:36.758532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-33c54bf4-f418-4ddd-a4d9-879b73ee592f tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.338394 Jun 02 10:20:36.776505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 382/755] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:36 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:37.184969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:37.186713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:37.194701 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.195423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.197011 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.197637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.406208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:37.426642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-026abfed-981d-480d-b01b-4d4c9da178a9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1453 microversion: 2.1 time: 0.249030 Jun 02 10:20:37.430934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 374/756] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:37 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1453 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:37.446646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:37.447683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:37.458224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.459544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.460072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.460671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.661289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:37.669177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f239be88-8f3d-4a40-b553-42138861a9e1 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1453 microversion: 2.1 time: 0.226657 Jun 02 10:20:37.675177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 383/757] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:37 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1453 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:37.776500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:37.777124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:37.784384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.784384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.785087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.785537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.940562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:37.948882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-777b479e-6700-47a6-941f-4e13bdbea14a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1511 microversion: 2.1 time: 0.176240 Jun 02 10:20:37.950668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 375/758] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:37 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:37.966141 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:37.966753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:37.974133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.974485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:37.975437 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:37.975880 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:38.455697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6179c6f9-dfc7-41f7-b1c9-e0e6435bbe8c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "POST /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae/action" status: 202 len: 0 microversion: 2.1 time: 0.493308 Jun 02 10:20:38.465822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:38.467265 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:38.472695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 384/759] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:20:37 2022] POST /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:20:38.475066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:38.475812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:38.477050 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:38.477703 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:38.691944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:38.712146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2854a24a-0367-49f6-ac0f-7cbaa4727c04 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1519 microversion: 2.1 time: 0.250079 Jun 02 10:20:38.739135 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-8d3d54d3-2c71-434a-b0d1-aa8555f06cd8 req-cfa233b1-4acd-476f-b63f-1e1f85b933e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "name": "network-vif-unplugged", "status": "completed", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:38.749778 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 376/760] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:38 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:38.765293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-8d3d54d3-2c71-434a-b0d1-aa8555f06cd8 req-cfa233b1-4acd-476f-b63f-1e1f85b933e9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:38.767803 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-8d3d54d3-2c71-434a-b0d1-aa8555f06cd8 req-cfa233b1-4acd-476f-b63f-1e1f85b933e9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:38.791455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.compute.server_external_events [req-8d3d54d3-2c71-434a-b0d1-aa8555f06cd8 req-cfa233b1-4acd-476f-b63f-1e1f85b933e9 service nova] Unable to find a host for instance 5999b411-b480-47b2-bcf8-5893bf9952ae. Dropping event network-vif-unplugged {{(pid=118066) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 02 10:20:38.792696 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-8d3d54d3-2c71-434a-b0d1-aa8555f06cd8 req-cfa233b1-4acd-476f-b63f-1e1f85b933e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067219 Jun 02 10:20:38.794260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 385/761] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 70 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 02 10:20:39.232752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-98c167f3-070e-48c5-bb7c-e6e99b9aa264 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: .version_select at 0x7f49ddd715e0>, body: {"keypair": {"name": "tempest-keypair-176650193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEu/pmRZtJs4SpaqbZknU8UZpPsfLrsdhn+blDt3r5AsQ/3yvxWS3xMn+F2w1nY8lRt0SKNO5tp5uC5xbKVUKu0bpeHvnPuMdjk3mHItyrehiG5IlxCSfsNF9C+ZPyatg=="}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:39.273996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-98c167f3-070e-48c5-bb7c-e6e99b9aa264 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for project 2083731013634acc8fcf98adceb19061. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:20:39.279743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-98c167f3-070e-48c5-bb7c-e6e99b9aa264 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for user 3a59ab67afb940fe96373251e2e80cf6 and project 2083731013634acc8fcf98adceb19061. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:20:39.407513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-98c167f3-070e-48c5-bb7c-e6e99b9aa264 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.334814 Jun 02 10:20:39.408403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 377/762] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:20:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:39.730004 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:39.731256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:39.743957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:39.743957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:39.743957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:39.743957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:39.927990 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:39.935613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3083c817-146a-47f3-a845-a37aae3e99ef tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1521 microversion: 2.1 time: 0.209663 Jun 02 10:20:39.936186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 386/763] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:39 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:40.686755 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-646135a0-0248-4c49-910a-cec0955fe0f3 req-75048325-5cf4-4e7d-9ec8-40352394cab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c48663-ab05-403a-b720-7de5695365ec", "tag": "ad59041b-c2bd-453d-a9a4-754ba8f1c306"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:40.700346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-646135a0-0248-4c49-910a-cec0955fe0f3 req-75048325-5cf4-4e7d-9ec8-40352394cab0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:40.701776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-646135a0-0248-4c49-910a-cec0955fe0f3 req-75048325-5cf4-4e7d-9ec8-40352394cab0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:40.722696 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-646135a0-0248-4c49-910a-cec0955fe0f3 req-75048325-5cf4-4e7d-9ec8-40352394cab0 service nova] Creating event network-changed:ad59041b-c2bd-453d-a9a4-754ba8f1c306 for instance f7c48663-ab05-403a-b720-7de5695365ec on hv-cinder-79760 Jun 02 10:20:40.729916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-646135a0-0248-4c49-910a-cec0955fe0f3 req-75048325-5cf4-4e7d-9ec8-40352394cab0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046607 Jun 02 10:20:40.731136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 378/764] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:40.954871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:40.956236 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:40.966835 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:40.974867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:40.976052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:40.976698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:41.236224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:41.246805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bf541a4e-e398-4094-a1a8-047bb1b7afa6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1521 microversion: 2.1 time: 0.295789 Jun 02 10:20:41.269787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 387/765] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:40 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:42.268643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:42.269228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:42.277810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:42.278263 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:42.279047 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:42.279572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:42.507582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:42.515440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c8a7d998-c12d-43d6-8e69-c3147caea011 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.252783 Jun 02 10:20:42.516029 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 379/766] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:42 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:42.833027 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1892492150", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88316dd4-c8ff-448d-8714-143f519f17d0"}], "security_groups": [{"name": "tempest-securitygroup--1477080649"}], "key_name": "tempest-keypair-176650193", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:42.931774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] validate_networks() for [('88316dd4-c8ff-448d-8714-143f519f17d0', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:20:43.303118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:20:43.303653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:20:43.304207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:20:43.304711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:20:43.305219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:20:43.315549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:43.316008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:43.316870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:43.317315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:43.335059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for project 2083731013634acc8fcf98adceb19061. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:20:43.337254 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:43.339559 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for user 3a59ab67afb940fe96373251e2e80cf6 and project 2083731013634acc8fcf98adceb19061. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:20:43.351242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:20:43.358271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:20:43.493139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cbeb39ae-0206-49de-a056-017693cec0db tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664223 Jun 02 10:20:43.493688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 388/767] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:20:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:20:43.503713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-02ccd7e7-8d84-4af9-b956-7ce9625bef94 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:43.504352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-02ccd7e7-8d84-4af9-b956-7ce9625bef94 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:43.533168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:43.533792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:43.541570 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:43.542036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:43.542884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:43.543534 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:43.566371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-02ccd7e7-8d84-4af9-b956-7ce9625bef94 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:43.575897 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-02ccd7e7-8d84-4af9-b956-7ce9625bef94 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1237 microversion: 2.1 time: 0.076036 Jun 02 10:20:43.576575 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 380/768] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:43 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:43.681526 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:43.689562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-19e6d9e7-6533-4d64-b727-72b053bf26c6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.161200 Jun 02 10:20:43.690128 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 389/769] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:43 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:44.593081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:44.593604 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:44.602714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:44.603195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:44.603965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:44.604407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:44.665386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:44.672734 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-77b44d9f-d4e5-43ea-8e79-edf6572727f5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1241 microversion: 2.1 time: 0.083632 Jun 02 10:20:44.673285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 381/770] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:44 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:44.706529 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:44.707415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:44.713735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:44.714189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:44.714956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:44.715430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:44.851074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:44.858864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b129bf6b-e91b-48ab-a78a-77f1280c15f6 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.157029 Jun 02 10:20:44.859467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 390/771] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:44 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:45.690021 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:45.690745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:45.697678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:45.698141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:45.698930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:45.699445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:45.777951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:45.786740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8cf80b5f-ca64-449b-bbbf-f972c31c07f7 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1295 microversion: 2.1 time: 0.101335 Jun 02 10:20:45.787354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 382/772] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:45 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1295 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:45.876331 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:45.876925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:45.883384 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:45.883846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:45.885697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:45.885697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:46.015828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:46.023291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0d7dc5d-c24b-415b-9eda-5726d782542e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.150882 Jun 02 10:20:46.023876 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 391/773] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:45 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:46.804445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:46.805151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:46.811854 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:46.812318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:46.813104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:46.813552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:47.013521 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:47.021578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e6639b95-eeef-473c-8e59-3966a4821274 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.221097 Jun 02 10:20:47.022201 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 383/774] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:46 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:47.040682 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:47.041322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:47.047986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:47.048533 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:47.049287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:47.049726 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:47.169827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-9320b5dc-fd4b-4118-bbd6-512abd746d86 req-60cc5145-3d3a-4bbb-adde-d6fe05c2d62e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ede6c0-6e2a-4152-9eaa-ddf55cdb958c", "tag": "3b579ddf-dbf9-4d50-a205-f2cdb717b2a6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:47.181906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-9320b5dc-fd4b-4118-bbd6-512abd746d86 req-60cc5145-3d3a-4bbb-adde-d6fe05c2d62e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:47.185261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:47.188873 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-9320b5dc-fd4b-4118-bbd6-512abd746d86 req-60cc5145-3d3a-4bbb-adde-d6fe05c2d62e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:47.195017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4958d7c9-658e-4777-90a1-d6082dbe907c tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.158231 Jun 02 10:20:47.195895 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 392/775] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:47 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:47.204991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-9320b5dc-fd4b-4118-bbd6-512abd746d86 req-60cc5145-3d3a-4bbb-adde-d6fe05c2d62e service nova] Creating event network-changed:3b579ddf-dbf9-4d50-a205-f2cdb717b2a6 for instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c on hv-cinder-79760 Jun 02 10:20:47.209980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-9320b5dc-fd4b-4118-bbd6-512abd746d86 req-60cc5145-3d3a-4bbb-adde-d6fe05c2d62e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048239 Jun 02 10:20:47.210582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 384/776] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:48.038203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:48.038802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:48.045297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:48.045880 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:48.046488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:48.046923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:48.170338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:48.178394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-09798b94-912a-4d1b-8899-c68712198fee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.143994 Jun 02 10:20:48.178964 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 393/777] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:48 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:48.213309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:48.214012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:48.220704 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:48.221154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:48.221916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:48.222385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:48.360056 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:48.368353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5d591fca-cdfe-4425-993d-c3508ac5a9d5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.159793 Jun 02 10:20:48.368935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 385/778] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:48 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:49.195669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:49.196291 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:49.202897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:49.203392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:49.204165 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:49.204613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:49.336144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:49.343668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5c9cefa9-7868-4509-a907-163644cf702c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.152010 Jun 02 10:20:49.344235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 394/779] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:49 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:49.386059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:49.386690 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:49.393334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:49.393790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:49.394560 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:49.395006 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:49.525613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:49.533664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-94ae1d5c-89ba-4288-ae9c-3c9eca10e291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.151706 Jun 02 10:20:49.534228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 386/780] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:49 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:50.359408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:50.360022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:50.366828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:50.367313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:50.368073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:50.368514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:50.496012 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:50.503867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8bd938a2-a2fa-43f4-9d95-165661328652 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.148385 Jun 02 10:20:50.504424 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 395/781] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:50 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:50.549673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:50.550293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:50.556972 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:50.557468 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:50.558312 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:50.558788 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:50.700702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:50.708321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-124c2e31-2254-46f2-9119-7ad013b3a45a tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.162487 Jun 02 10:20:50.708986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 387/782] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:50 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:51.520838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:51.521467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:51.528104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:51.528554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:51.529310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:51.529743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:51.534338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:51.657956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:51.665991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-aa04bd42-e7f0-48e5-b51d-f46305b69994 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.149720 Jun 02 10:20:51.666564 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 396/783] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:51 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:51.725838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:51.726376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:51.732864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:51.733320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:51.734093 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:51.734539 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:51.866556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:51.874120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6c7c8d55-4f68-4ffe-a03f-99082bd0d7d8 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.152187 Jun 02 10:20:51.874687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 388/784] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:51 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:52.681719 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:52.682574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:52.689153 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:52.689604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:52.690361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:52.690822 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:52.827452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:52.834877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a623ded7-9e07-4221-bd6e-0a3483b8e9f8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.156996 Jun 02 10:20:52.835478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 397/785] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:52 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:52.892239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:52.893005 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:52.899783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:52.903810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:52.903810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:52.903810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:52.950040 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-45c9cb03-aaf0-4aeb-a3e7-f40a8b51578b req-6c61a471-3b3a-4618-9512-f2de3e7607f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ede6c0-6e2a-4152-9eaa-ddf55cdb958c", "name": "network-vif-plugged", "status": "completed", "tag": "3b579ddf-dbf9-4d50-a205-f2cdb717b2a6"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:52.958571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-45c9cb03-aaf0-4aeb-a3e7-f40a8b51578b req-6c61a471-3b3a-4618-9512-f2de3e7607f5 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:52.959015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-45c9cb03-aaf0-4aeb-a3e7-f40a8b51578b req-6c61a471-3b3a-4618-9512-f2de3e7607f5 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:52.970733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-45c9cb03-aaf0-4aeb-a3e7-f40a8b51578b req-6c61a471-3b3a-4618-9512-f2de3e7607f5 service nova] Creating event network-vif-plugged:3b579ddf-dbf9-4d50-a205-f2cdb717b2a6 for instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c on hv-cinder-79760 Jun 02 10:20:52.976127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-45c9cb03-aaf0-4aeb-a3e7-f40a8b51578b req-6c61a471-3b3a-4618-9512-f2de3e7607f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029785 Jun 02 10:20:52.976741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 398/786] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:53.042082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:53.054461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a48a739f-ceb4-4564-a0f9-46f47141d291 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.162393 Jun 02 10:20:53.054461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 389/787] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:52 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:53.848064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:53.854108 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:53.854108 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:53.854108 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:53.860237 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:53.861343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:53.862095 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:53.862571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:53.989949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:53.997423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cefa606e-6af0-42f1-9607-0d9f1e0b25c9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.150244 Jun 02 10:20:53.997916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 399/788] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:53 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:54.067182 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:54.067797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:54.069833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:54.075313 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:54.075767 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:54.076530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:54.077012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:54.210035 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:54.217529 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d63eee69-bac5-4580-a42d-6b5407b8e004 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.154264 Jun 02 10:20:54.218098 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 390/789] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:54 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:55.008010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-50f9ffb1-1212-46f9-bce8-caf7bbfa6590 req-163c9e0d-e164-47f2-87ae-e92211f08f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "name": "network-vif-plugged", "status": "completed", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:55.013493 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:55.014112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:55.016004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:55.018465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-50f9ffb1-1212-46f9-bce8-caf7bbfa6590 req-163c9e0d-e164-47f2-87ae-e92211f08f7a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:55.018912 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-50f9ffb1-1212-46f9-bce8-caf7bbfa6590 req-163c9e0d-e164-47f2-87ae-e92211f08f7a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:55.022123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:55.022582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:55.023483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:55.023884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:55.027935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:55.029961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-50f9ffb1-1212-46f9-bce8-caf7bbfa6590 req-163c9e0d-e164-47f2-87ae-e92211f08f7a service nova] Creating event network-vif-plugged:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:20:55.034761 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-50f9ffb1-1212-46f9-bce8-caf7bbfa6590 req-163c9e0d-e164-47f2-87ae-e92211f08f7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030421 Jun 02 10:20:55.035382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 400/790] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:55.152210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:55.160234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2dbd8796-e572-42a4-a86b-06b13c87da2b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1363 microversion: 2.1 time: 0.150617 Jun 02 10:20:55.160794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 391/791] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:55 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:55.236821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:55.237557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:55.244328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:55.244782 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:55.245557 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:55.246002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:55.387547 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:55.395598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ae0a5a28-b993-491d-9900-7db0d153a3c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.163979 Jun 02 10:20:55.396354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 401/792] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:55 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:56.177262 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:56.177915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:56.184529 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.184982 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.185755 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.186200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.319892 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:56.327402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2f1a9928-38ed-4d3a-9e1a-1453cd6ae794 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1550 microversion: 2.1 time: 0.154546 Jun 02 10:20:56.327965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 392/793] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:56 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:56.343422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:56.343924 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:56.350605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.351064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.351859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.352301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.413069 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:56.413679 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:56.419534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.419994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.420764 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:56.421203 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:56.426653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-32778295-e767-4a5b-85a1-08a5c58f4c91 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086991 Jun 02 10:20:56.427342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 402/794] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:20:56 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:20:56.552647 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:56.560178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4b70c248-d084-483b-a129-bbc7fde07398 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.151030 Jun 02 10:20:56.560744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 393/795] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:56 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:20:57.577977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:57.578709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:57.585396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:57.585851 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:57.586622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:57.587066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:57.724476 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-5d2d9c62-6aeb-4468-8841-eb60b1dc9473 req-430c74b4-5e07-4df7-802a-7d9257f31e34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ede6c0-6e2a-4152-9eaa-ddf55cdb958c", "tag": "3b579ddf-dbf9-4d50-a205-f2cdb717b2a6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:20:57.733914 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-5d2d9c62-6aeb-4468-8841-eb60b1dc9473 req-430c74b4-5e07-4df7-802a-7d9257f31e34 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:57.734370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-5d2d9c62-6aeb-4468-8841-eb60b1dc9473 req-430c74b4-5e07-4df7-802a-7d9257f31e34 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:57.747721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-5d2d9c62-6aeb-4468-8841-eb60b1dc9473 req-430c74b4-5e07-4df7-802a-7d9257f31e34 service nova] Creating event network-changed:3b579ddf-dbf9-4d50-a205-f2cdb717b2a6 for instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c on hv-cinder-79760 Jun 02 10:20:57.754669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-5d2d9c62-6aeb-4468-8841-eb60b1dc9473 req-430c74b4-5e07-4df7-802a-7d9257f31e34 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034085 Jun 02 10:20:57.755886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 394/796] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:20:57.774539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:57.784273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-69c82e3c-8c4d-47bd-b89b-4ab6ba9f110e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1577 microversion: 2.1 time: 0.210701 Jun 02 10:20:57.784846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 403/797] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:57 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:20:58.802567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:20:58.803330 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:20:58.810052 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:58.810517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:58.811316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:20:58.811765 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:20:58.948989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:20:58.956815 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d29f0628-02e6-4128-a3ae-9aeccd6c532e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1564 microversion: 2.1 time: 0.159358 Jun 02 10:20:58.957421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 395/798] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:20:58 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:06.911593 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:06.912215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:06.918755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:06.919243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:06.920044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:06.920480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:06.943674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2853173b-b5fd-483f-aa1a-10b99fc70e1a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/ips" status: 200 len: 150 microversion: 2.1 time: 0.036441 Jun 02 10:21:06.944240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 404/799] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:21:06 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:21:08.594483 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41399621-0528-4b2e-9b16-0c6d6c11a765"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:08.595595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:08.602895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:08.604954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:08.604954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:08.604954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:09.272731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7cb31cdb-4e9e-4e16-a6d4-a282a5083813 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.682110 Jun 02 10:21:09.273361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 396/800] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:21:08 2022] POST /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments => generated 194 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:16.756073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41399621-0528-4b2e-9b16-0c6d6c11a765"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:16.757425 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:16.759542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:16.764224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:16.764668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:16.765414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:16.765847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:16.845783 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: POST /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments HTTP/1.1 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 74 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:21:16.847632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {"volumeAttachment": {"volumeId": "41399621-0528-4b2e-9b16-0c6d6c11a765"}} Jun 02 10:21:16.849299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'server_id': 'c9d81486-ec35-4e30-914c-9c54e61ca205', 'body': {'volumeAttachment': {'volumeId': '41399621-0528-4b2e-9b16-0c6d6c11a765'}}} Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:21:16.850124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:16.851571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 400 to user: Invalid volume: volume 41399621-0528-4b2e-9b16-0c6d6c11a765 is already attached to instances: c9d81486-ec35-4e30-914c-9c54e61ca205 {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f656dc91-bd98-4fea-9adf-d9d0a49ece47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097442 Jun 02 10:21:16.853201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 405/801] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:21:16 2022] POST /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:21:16.910822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:16.911396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:16.917534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:16.917980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:16.918735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:16.919203 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:16.997093 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'services' on Instance uuid c9d81486-ec35-4e30-914c-9c54e61ca205 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:21:17.198227 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-03dcf404-d2df-41d2-80da-77cfffdf4b45 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments/41399621-0528-4b2e-9b16-0c6d6c11a765" status: 202 len: 0 microversion: 2.1 time: 0.292022 Jun 02 10:21:17.198764 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 397/802] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:21:16 2022] DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments/41399621-0528-4b2e-9b16-0c6d6c11a765 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:21:17.207816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:17.208846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:17.214955 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:17.215440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:17.216203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:17.216641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:17.247544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e669f298-c5fd-4e72-8f1c-78566a65b17a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 Jun 02 10:21:17.248134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 406/803] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:21:17 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:18.260597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:18.261669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:18.268827 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:18.269096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:18.269882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:18.270330 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:18.299507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a4f67cb3-32a9-414b-9b08-ddd9491e2c69 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Jun 02 10:21:18.300074 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 398/804] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:21:18 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:19.311046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:19.312024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:19.318865 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.319365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.320121 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.320556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.349216 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6a30c1c4-5e0c-4171-b0e1-0e23b49d6396 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042218 Jun 02 10:21:19.349758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 407/805] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:21:19 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:21:19.404343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:19.404837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:19.412126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.412582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.413341 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.413780 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.437492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:21:19.690777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-badb282c-2158-4db3-8c93-75bd7db51e61 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 204 len: 0 microversion: 2.1 time: 0.289347 Jun 02 10:21:19.691327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 399/806] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:21:19 2022] DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:21:19.700464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:19.701087 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:19.707753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.708206 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.708973 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:19.709415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:19.837591 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:19.845091 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d9dc2a27-7aaf-4b53-aaf8-d3db0ac8d308 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1682 microversion: 2.1 time: 0.148848 Jun 02 10:21:19.845643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 408/807] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:19 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:20.863224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:20.863943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:20.870363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:20.870816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:20.871617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:20.872064 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:21.000948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:21.009107 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-43b8525c-4db3-4e1a-b81f-6d649710119f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1682 microversion: 2.1 time: 0.150465 Jun 02 10:21:21.009676 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 400/808] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:20 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:22.027028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:22.027698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:22.034668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:22.035147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:22.035916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:22.036349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:22.039034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=65 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:22.169695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:22.177864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1b165abd-a80d-4a7f-89b3-634bef9cac48 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1682 microversion: 2.1 time: 0.154695 Jun 02 10:21:22.178745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 409/809] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:22 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:22.585288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-3181ec9d-0ee1-45eb-9b23-178a4e784a3d req-bf9bbe20-56e1-48ef-a6f0-0e6021de6b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d81486-ec35-4e30-914c-9c54e61ca205", "name": "network-vif-deleted", "tag": "ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:22.594012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-3181ec9d-0ee1-45eb-9b23-178a4e784a3d req-bf9bbe20-56e1-48ef-a6f0-0e6021de6b9d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:22.594461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-3181ec9d-0ee1-45eb-9b23-178a4e784a3d req-bf9bbe20-56e1-48ef-a6f0-0e6021de6b9d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:22.606047 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-3181ec9d-0ee1-45eb-9b23-178a4e784a3d req-bf9bbe20-56e1-48ef-a6f0-0e6021de6b9d service nova] Creating event network-vif-deleted:ccb7ced1-5ee4-4cb2-9069-092ce95ccf1c for instance c9d81486-ec35-4e30-914c-9c54e61ca205 on hv-cinder-79760 Jun 02 10:21:22.611364 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-3181ec9d-0ee1-45eb-9b23-178a4e784a3d req-bf9bbe20-56e1-48ef-a6f0-0e6021de6b9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 Jun 02 10:21:22.612551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 401/810] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:23.195477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:23.196099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:23.202688 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:23.203166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:23.203931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:23.204364 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:23.237042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:23.237489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:23.237939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'fault' on Instance uuid c9d81486-ec35-4e30-914c-9c54e61ca205 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:21:23.280034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:23.287712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f03b2395-a4df-4a1d-8390-12ab01f3f9ed tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 200 len: 1331 microversion: 2.1 time: 0.096211 Jun 02 10:21:23.288282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 410/811] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:23 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:24.306772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:24.307616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:24.313913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:24.314369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:24.315175 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:24.315808 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:24.329405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 HTTP/1.1 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:21:24.331070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:21:24.333171 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'c9d81486-ec35-4e30-914c-9c54e61ca205'} Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:21:24.334013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:21:24.335394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:21:24.336524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:21:24.336524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-359a0e99-0dc6-4067-825a-229036c442b8 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 404 len: 111 microversion: 2.1 time: 0.031118 Jun 02 10:21:24.336524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 402/812] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:24 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:24.342041 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-85460914-6b39-40a2-a32a-e3baa162b772 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '.version_select at 0x7f49ddde7c10>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:24.428279 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-85460914-6b39-40a2-a32a-e3baa162b772 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409590177" status: 202 len: 0 microversion: 2.1 time: 0.090004 Jun 02 10:21:24.428839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 411/813] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 2 10:21:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409590177 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:21:25.164106 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e9741a0d-f35b-4ed1-ba33-b699533d4a7b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: .version_select at 0x7f49dddc9a60>, body: {"keypair": {"name": "tempest-keypair-1062846397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcX5TGqm4MMs7POtV8a64A9kFJrsXuAO4WZrfmMT58huuDLOF5f2/S+lfwC4nGWI+Q9Td1FduLif+fmdKvodHEgCqFGjcq5D5My3tGWiOCrIAWWr6cpwlRf6o1uJPN93Q=="}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:25.168461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:25.179697 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-e9741a0d-f35b-4ed1-ba33-b699533d4a7b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:21:25.183548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-e9741a0d-f35b-4ed1-ba33-b699533d4a7b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:21:25.251534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e9741a0d-f35b-4ed1-ba33-b699533d4a7b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091334 Jun 02 10:21:25.252120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 403/814] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:21:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:27.371207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2135066036", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "63a76883-1c17-4c5d-93bd-cf38b26e86c2"}], "security_groups": [{"name": "tempest-securitygroup--664750898"}], "key_name": "tempest-keypair-1062846397", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:27.473083 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] validate_networks() for [('63a76883-1c17-4c5d-93bd-cf38b26e86c2', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:21:27.826193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:21:27.826567 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:21:27.827048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:21:27.827493 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:21:27.827908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:21:27.837226 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:27.837680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:27.838480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:27.838921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:27.855371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:21:27.859309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Getting quotas for user 0514d3b22d94435196f8bf1eff26699e and project ea502039a02d4d5db21dcc41c98a52a5. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:21:27.870391 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:21:27.872910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:21:27.983523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-936b4282-1fa1-4c04-a470-46b484bfaf73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617224 Jun 02 10:21:27.984163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 412/815] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:21:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:21:27.995146 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1ecc94d5-163e-4c8b-b4fd-148eb8e7735b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:27.995830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1ecc94d5-163e-4c8b-b4fd-148eb8e7735b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:28.054532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1ecc94d5-163e-4c8b-b4fd-148eb8e7735b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:28.061395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1ecc94d5-163e-4c8b-b4fd-148eb8e7735b tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1242 microversion: 2.1 time: 0.070725 Jun 02 10:21:28.061962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 404/816] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:27 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:29.079334 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:29.079986 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:29.087675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:29.088251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:29.089026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:29.089471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:29.159939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:29.167828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6c889b39-7fff-4077-9445-b21330cf18d0 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1238 microversion: 2.1 time: 0.092540 Jun 02 10:21:29.168380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 413/817] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:29 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1238 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:30.185499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:30.186672 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:30.193329 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:30.193781 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:30.194549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:30.194986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:30.198960 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:30.257554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:30.265853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-086ae7fc-32a5-4def-a1fd-78dcc173bfaa tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1300 microversion: 2.1 time: 0.084321 Jun 02 10:21:30.266420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 405/818] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:30 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:31.242166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-38798dd3-b1b8-43d3-9bd4-5b481e954b68 req-557580df-ba1d-4149-9bc0-c84fcae24b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c7abd6-91c7-4f08-bb0c-6a34db65a835", "tag": "e13b22ad-5ecd-4417-ba43-9edff7b31a75"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:31.251235 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-38798dd3-b1b8-43d3-9bd4-5b481e954b68 req-557580df-ba1d-4149-9bc0-c84fcae24b6e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:31.252899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-38798dd3-b1b8-43d3-9bd4-5b481e954b68 req-557580df-ba1d-4149-9bc0-c84fcae24b6e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:31.270460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-38798dd3-b1b8-43d3-9bd4-5b481e954b68 req-557580df-ba1d-4149-9bc0-c84fcae24b6e service nova] Creating event network-changed:e13b22ad-5ecd-4417-ba43-9edff7b31a75 for instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 on hv-cinder-79760 Jun 02 10:21:31.276984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-38798dd3-b1b8-43d3-9bd4-5b481e954b68 req-557580df-ba1d-4149-9bc0-c84fcae24b6e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040103 Jun 02 10:21:31.281527 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 414/819] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:31.284437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:31.286386 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:31.294969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:31.295577 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:31.296523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:31.297034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:31.526882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:31.534918 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-84cbb897-15b1-45d0-9967-181d68df0d0e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.255038 Jun 02 10:21:31.535519 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 406/820] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:31 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:32.553350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:32.554042 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:32.560300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:32.560746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:32.561497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:32.561929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:32.709319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:32.716787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8aaeed48-1831-4948-9ac8-7cc78a971421 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.168602 Jun 02 10:21:32.717345 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 415/821] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:32 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:33.733354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:33.733977 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:33.740920 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:33.741370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:33.742145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:33.742590 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:33.874553 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:33.882431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dfa267c6-16b6-4da6-bc74-ae3d5f0851d3 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.153042 Jun 02 10:21:33.882992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 407/822] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:33 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:34.899736 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:34.900354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:34.906900 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:34.907386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:34.908159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:34.908604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:35.036582 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:35.043928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8ebd051d-c176-4505-89bb-c04ac6817d47 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.148122 Jun 02 10:21:35.044492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 416/823] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:34 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:36.060698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:36.061320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:36.067887 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:36.068341 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:36.069109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:36.069552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:36.195895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:36.203286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-794e7f2a-4ee1-4332-b593-13a00870b1df tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.146429 Jun 02 10:21:36.203847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 408/824] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:36 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:37.077594 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-3227ca6b-9f92-4416-b59a-1fb7026a6733 req-63f8552b-9f82-4260-8279-de6d12f6e619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c7abd6-91c7-4f08-bb0c-6a34db65a835", "name": "network-vif-plugged", "status": "completed", "tag": "e13b22ad-5ecd-4417-ba43-9edff7b31a75"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:37.085810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-3227ca6b-9f92-4416-b59a-1fb7026a6733 req-63f8552b-9f82-4260-8279-de6d12f6e619 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:37.086276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-3227ca6b-9f92-4416-b59a-1fb7026a6733 req-63f8552b-9f82-4260-8279-de6d12f6e619 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:37.097270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-3227ca6b-9f92-4416-b59a-1fb7026a6733 req-63f8552b-9f82-4260-8279-de6d12f6e619 service nova] Creating event network-vif-plugged:e13b22ad-5ecd-4417-ba43-9edff7b31a75 for instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 on hv-cinder-79760 Jun 02 10:21:37.102377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-3227ca6b-9f92-4416-b59a-1fb7026a6733 req-63f8552b-9f82-4260-8279-de6d12f6e619 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029078 Jun 02 10:21:37.102979 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 417/825] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:37.220242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:37.233061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:37.233061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:37.233061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:37.233061 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:37.233461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:37.365126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:37.369411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dad4de32-7cc5-40b8-9237-785799fc573e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.153066 Jun 02 10:21:37.369980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 409/826] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:37 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:38.387842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:38.388467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:38.390415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:38.391105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:38.397140 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:38.399269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:38.399269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:38.399269 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:38.531508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:38.538922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b9ada2ca-4053-477d-a1ff-4403fc9d06d9 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1367 microversion: 2.1 time: 0.155457 Jun 02 10:21:38.539519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 418/827] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:38 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:39.555357 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:39.556008 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:39.557865 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:39.563228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:39.563681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:39.564445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:39.564912 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:39.692437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:21:39.699801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-064b4754-de5e-4fe6-ab08-bf274e6de93c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1557 microversion: 2.1 time: 0.148352 Jun 02 10:21:39.700369 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 410/828] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:21:39 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:21:39.716633 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:21:39.717145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:21:39.723774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:39.724233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:39.725006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:39.725451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:39.801185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-aeebaadd-1b60-454a-9dcc-30e8612f6bf2 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088594 Jun 02 10:21:39.801771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 419/829] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:21:39 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:21:40.736622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-43b0875b-648a-4a7c-9d9d-c8fbdeb782ee req-6b75a904-9445-424d-876b-2efdbd8ec425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c7abd6-91c7-4f08-bb0c-6a34db65a835", "tag": "e13b22ad-5ecd-4417-ba43-9edff7b31a75"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:21:40.746337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-43b0875b-648a-4a7c-9d9d-c8fbdeb782ee req-6b75a904-9445-424d-876b-2efdbd8ec425 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:21:40.747229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-43b0875b-648a-4a7c-9d9d-c8fbdeb782ee req-6b75a904-9445-424d-876b-2efdbd8ec425 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:21:40.760235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-43b0875b-648a-4a7c-9d9d-c8fbdeb782ee req-6b75a904-9445-424d-876b-2efdbd8ec425 service nova] Creating event network-changed:e13b22ad-5ecd-4417-ba43-9edff7b31a75 for instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 on hv-cinder-79760 Jun 02 10:21:40.766136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-43b0875b-648a-4a7c-9d9d-c8fbdeb782ee req-6b75a904-9445-424d-876b-2efdbd8ec425 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Jun 02 10:21:40.766737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 411/830] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:03.915594 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:03.916348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=47 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:03.920181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:03.920674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:03.926429 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:03.942655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:03.942655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:03.942655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:03.950740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1e5a7913-3348-482e-a2df-aeba4c6bcd67 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/ips" status: 200 len: 152 microversion: 2.20 time: 0.036587 Jun 02 10:22:03.951318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 420/831] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 2 10:22:03 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:22:06.080212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:06.080830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:06.083070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:06.083717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=37 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:06.088609 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:06.089057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:06.089817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:06.090255 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:06.113547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lazy-loading 'flavor' on Instance uuid 16b938d7-e7b3-49c8-9347-00e886063ae0 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:22:06.666142 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8fbc3067-b3d1-4541-818a-a9744d62653f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/action" status: 202 len: 0 microversion: 2.20 time: 0.589970 Jun 02 10:22:06.666817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 412/832] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 2 10:22:06 2022] POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:22:06.676019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:06.676690 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:06.684116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:06.689748 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:06.689748 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:06.689748 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:06.814589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:06.822843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:06.824600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:06.825697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3dde27cf-880e-4473-94f6-9ac572b56f63 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.154746 Jun 02 10:22:06.826247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 421/833] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:06 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:07.845435 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:07.846168 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:07.853191 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:07.853648 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:07.854416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:07.854860 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:07.983368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:07.991623 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:07.993274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:07.994445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-adb63e2c-cd95-402e-b67f-eea34cda61dc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.153800 Jun 02 10:22:07.995007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 413/834] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:07 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:09.013098 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:09.014326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:09.021023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:09.021538 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:09.022316 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:09.022757 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:09.149288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:09.157133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:09.158644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:09.160315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b60b1a00-99db-4546-8f26-07dac5800529 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.151152 Jun 02 10:22:09.160870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 422/835] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:09 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:22:10.178394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:10.178987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:10.185830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:10.187231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:10.187231 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:10.187516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:10.322193 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:10.330147 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:10.331753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:10.332956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6ebd7c9e-ae8d-4174-91af-7b79ccd49651 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.159150 Jun 02 10:22:10.333517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 414/836] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:10 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:11.350944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:11.351584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:11.358080 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:11.358798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:11.359594 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:11.360039 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:11.488620 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:11.496396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:11.497907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:11.499070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-861999aa-93b9-450f-a435-9a7c5486f3cb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.152208 Jun 02 10:22:11.499653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 423/837] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:11 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:12.517872 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:12.518899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:12.525400 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:12.525853 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:12.526617 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:12.527060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:12.654620 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:12.662463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:12.664015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:12.665163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-45eaa08e-8d23-48b7-8885-ee6fa6d5c526 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.151383 Jun 02 10:22:12.665752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 415/838] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:12 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:13.682273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:13.682880 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:13.689313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:13.689753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:13.690505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:13.690937 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:13.815587 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:13.823500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:13.825014 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:13.826170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-40645fb0-6d33-48e0-be9a-65abcd31bd90 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.147763 Jun 02 10:22:13.826727 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 424/839] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:13 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:14.848432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:14.849051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:14.855568 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:14.856024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:14.856797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:14.857242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:14.988399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:14.996253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:14.997748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:14.998901 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5a4e780a-7165-44dc-875b-7156502b580b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.158275 Jun 02 10:22:14.999478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 416/840] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:14 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:16.017069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:16.017715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:16.024918 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:16.025466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:16.026251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:16.026692 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:16.155758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:16.164612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:16.166166 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:16.167359 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-213c8c4e-7880-4121-a70e-d4221ab64cf4 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.154244 Jun 02 10:22:16.167911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 425/841] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:16 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:17.185661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:17.186274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:17.193482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:17.193948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:17.194720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:17.195173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:17.326919 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:17.335464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:17.336971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:17.338129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bc9d8352-8622-4738-a85d-902ce34c835c tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.156443 Jun 02 10:22:17.338682 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 417/842] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:17 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:18.356088 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:18.356699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:18.363481 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:18.363938 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:18.364700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:18.365139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:18.492085 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:18.500030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:18.501534 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:18.502685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-095cde78-2d8b-47e4-9799-409be8812fa5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.150626 Jun 02 10:22:18.503262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 426/843] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:18 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:19.521162 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:19.521713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:19.528570 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:19.529027 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:19.529795 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:19.530264 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:19.661420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:19.669477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:19.671003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:19.672194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6365d598-c919-4c64-a348-4e3ee0de6443 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.155092 Jun 02 10:22:19.672753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 418/844] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:19 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:20.689667 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:20.690843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:20.697574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:20.698145 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:20.698915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:20.699381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:20.825005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:20.832962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:20.834578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:20.835767 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-feb27365-33b0-4e3f-81d0-e1ab867927b8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.149942 Jun 02 10:22:20.836327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 427/845] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:20 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:22:21.853824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:21.854445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:21.861277 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:21.861724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:21.862485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:21.862925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:21.993611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:22.001469 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:22.003530 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:22.004689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cf1e9b33-95b0-47dd-afd5-73692bcb4477 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.154830 Jun 02 10:22:22.005252 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 419/846] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:21 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:23.023118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:23.023712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:23.030099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:23.030545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:23.031330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:23.031766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:23.168118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:23.176116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:23.177603 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:23.178755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c1cf0281-4883-4063-9475-b0982f6930ce tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.159610 Jun 02 10:22:23.179535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 428/847] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:23 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:23.195022 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-b4167709-9e57-4ea4-b0ab-6291cc980d96 req-ce62d2ec-9369-4a8b-975a-3fcde88c7dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "name": "network-vif-plugged", "status": "completed", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:23.203630 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-b4167709-9e57-4ea4-b0ab-6291cc980d96 req-ce62d2ec-9369-4a8b-975a-3fcde88c7dd9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:23.204141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-b4167709-9e57-4ea4-b0ab-6291cc980d96 req-ce62d2ec-9369-4a8b-975a-3fcde88c7dd9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:23.215801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-b4167709-9e57-4ea4-b0ab-6291cc980d96 req-ce62d2ec-9369-4a8b-975a-3fcde88c7dd9 service nova] Creating event network-vif-plugged:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:22:23.220814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-b4167709-9e57-4ea4-b0ab-6291cc980d96 req-ce62d2ec-9369-4a8b-975a-3fcde88c7dd9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029491 Jun 02 10:22:23.221461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 420/848] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:24.196574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:24.197217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:24.204855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:24.205315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:24.206078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:24.206523 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:24.336207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:24.344077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:24.345589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:24.347375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dd0da718-5b3d-40e4-8fe0-7c83f7818394 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1744 microversion: 2.20 time: 0.154823 Jun 02 10:22:24.347926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 429/849] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:24 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:25.366612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:25.367399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:25.373971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:25.374584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:25.375455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:25.375917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:25.510459 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:25.519017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:25.524409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:25.524409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8aaffc6e-fbaa-4d44-8e59-90c3e5061ebe tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.159816 Jun 02 10:22:25.524409 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 421/850] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:25 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:26.539651 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:26.540956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:26.548363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:26.549315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:26.550073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:26.550510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:26.691304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:26.700005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:26.701830 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:26.703292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-917a250e-774a-4b33-989a-d86026e27aeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.167597 Jun 02 10:22:26.713614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 430/851] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:26 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:27.544337 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:27.544896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:27.552412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:27.552955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:27.553948 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:27.554494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:27.581773 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7772be13-d5ba-4385-bf47-3585c1dccef5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/ips" status: 200 len: 147 microversion: 2.1 time: 0.041255 Jun 02 10:22:27.588250 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 422/852] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:22:27 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:27.721787 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:27.722441 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:27.730573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:27.731250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:27.732315 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:27.732858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:27.874168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:27.883311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:27.885569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:27.886373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-959e5808-6967-4406-a930-517d91cd12db tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.168903 Jun 02 10:22:27.895171 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 431/853] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:27 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:28.907359 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:28.908019 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:28.913978 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:28.914419 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:28.915210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:28.915645 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:29.048121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:29.057065 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:29.058574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:29.059773 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9de97ea9-db7d-4f99-beac-751c8626af46 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.156577 Jun 02 10:22:29.060513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 423/854] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:28 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:30.084173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:30.085038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:30.101574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:30.102026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:30.102816 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:30.105288 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:30.311340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:30.321484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:30.323051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:30.324471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1dfd1f4f-721f-4cce-ad2b-32c3d5978840 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.247762 Jun 02 10:22:30.331577 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 432/855] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:30 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:30.999340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5be5ef4-e3e5-4b85-bd86-59f5438fcb04"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:31.004752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:31.007783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:31.008348 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:31.009136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:31.009587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:31.343297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:31.344115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:31.351175 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:31.351951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:31.353069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:31.353613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:31.496070 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:31.504619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:31.506363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:31.507741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f450d0f4-5e66-4e5c-9f1f-798e6db6607e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.169497 Jun 02 10:22:31.508290 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 433/856] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:31 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:31.595368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-34a7c4be-5c2a-4dfa-a601-7fde623e1fe5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599749 Jun 02 10:22:31.596833 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 424/857] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:22:30 2022] POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments => generated 194 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:32.526386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:32.527333 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:32.535990 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:32.536699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:32.537679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:32.538119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:32.696809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:32.706542 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:32.708089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:32.709610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5db4653e-a0ee-417a-a2d6-5b9a3d36b025 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.187660 Jun 02 10:22:32.719897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 434/858] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:32 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:33.728796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:33.729489 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:33.738009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:33.739921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:33.742249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:33.743616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:33.891345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:33.899885 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:33.901548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:33.902789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9407bad1-d0d7-4f8b-8aa8-68dc238ad39a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.178782 Jun 02 10:22:33.903447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 425/859] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:33 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:34.921572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:34.922162 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:34.929577 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:34.930238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:34.931278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:34.931942 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:35.066693 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:35.074712 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:35.076276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:35.077436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-18266563-2f8a-4cb7-bde5-6c64dd6e9095 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.159759 Jun 02 10:22:35.077985 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 435/860] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:34 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:36.096207 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:36.096753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:36.103535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:36.103984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:36.104756 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:36.105198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:36.109695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:36.250695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:36.264089 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:36.265594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:36.266774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b0d3cf57-d50e-4108-b2d6-acfff73ed6f9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.174824 Jun 02 10:22:36.275421 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 426/861] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:36 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:37.286300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:37.286905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:37.289329 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=33 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:37.294062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:37.294512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:37.295308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:37.295740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:37.298233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=95 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:37.423661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:37.431392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:37.432883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:37.434027 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-acce36fd-32d9-40b4-a630-3c9e449a82e9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1739 microversion: 2.20 time: 0.152298 Jun 02 10:22:37.434580 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 436/862] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:37 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:38.452063 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:38.452683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:38.455749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=31 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:38.460657 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:38.461121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:38.461921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:38.462363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:38.680134 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:38.688780 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:38.690942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:38.692143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3b24bc22-ce39-4461-9585-ccf2db24c6cc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1721 microversion: 2.20 time: 0.244038 Jun 02 10:22:38.692708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 427/863] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:38 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:39.711074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:39.711714 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:39.718136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:39.718579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:39.719377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:39.719814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:39.848773 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:39.856689 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:39.858463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:39.859665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4f9f80e5-3db5-460a-8b50-0024eb760458 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1721 microversion: 2.20 time: 0.152522 Jun 02 10:22:39.860227 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 437/864] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:39 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:40.181503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-99ee9d09-7acd-4185-86b9-25dad9e8d01a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:40.188133 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99ee9d09-7acd-4185-86b9-25dad9e8d01a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:40.188621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-99ee9d09-7acd-4185-86b9-25dad9e8d01a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:40.247525 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-99ee9d09-7acd-4185-86b9-25dad9e8d01a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Going to try to stop instance {{(pid=118067) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 10:22:40.394010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-99ee9d09-7acd-4185-86b9-25dad9e8d01a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action" status: 202 len: 0 microversion: 2.1 time: 0.216233 Jun 02 10:22:40.394542 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 428/865] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:22:40 2022] POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:22:40.402561 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:40.403202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:40.409649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:40.410102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:40.410866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:40.411341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:40.535535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:40.543367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a9fc4871-4ddb-4a0d-90e7-6c0f5defc981 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.144561 Jun 02 10:22:40.543922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 438/866] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:40 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:40.878238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:40.879399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:40.885377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:40.889217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:40.889217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:40.889217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:41.018605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:41.026496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:41.028034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:41.029188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-16d45a90-dd5f-4822-832b-4399adf9ebff tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1721 microversion: 2.20 time: 0.155267 Jun 02 10:22:41.029750 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 429/867] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:40 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:41.284211 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-b5b0fbc1-b84d-4a07-a5de-5d80ccaa9382 req-91dbd14d-cd98-4fad-b2bc-59a8bf973e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "name": "network-vif-unplugged", "status": "completed", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:41.293053 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b5b0fbc1-b84d-4a07-a5de-5d80ccaa9382 req-91dbd14d-cd98-4fad-b2bc-59a8bf973e01 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:41.293508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-b5b0fbc1-b84d-4a07-a5de-5d80ccaa9382 req-91dbd14d-cd98-4fad-b2bc-59a8bf973e01 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:41.304623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-b5b0fbc1-b84d-4a07-a5de-5d80ccaa9382 req-91dbd14d-cd98-4fad-b2bc-59a8bf973e01 service nova] Creating event network-vif-unplugged:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:22:41.309556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-b5b0fbc1-b84d-4a07-a5de-5d80ccaa9382 req-91dbd14d-cd98-4fad-b2bc-59a8bf973e01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029465 Jun 02 10:22:41.310156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 439/868] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:41.561557 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:41.562215 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:41.569553 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:41.569995 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:41.570769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:41.571358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:41.706842 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:41.715195 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e72090d3-88e9-427b-bf14-41a5603549b8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.157650 Jun 02 10:22:41.715761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 430/869] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:41 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:42.049230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:42.049961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:42.056207 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.056826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.057604 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.058099 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.188575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:42.196624 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:42.198149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:42.199385 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d8d98d2b-eeb8-4503-9cb3-173f5bc0beeb tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1664 microversion: 2.20 time: 0.154953 Jun 02 10:22:42.199884 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 440/870] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:42 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:42.217344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f06c56a4-2ae9-481f-92d1-cd2838ff72df"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:42.221371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:42.225104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.225558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.226439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.226745 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.732019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:42.732877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:42.739231 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.739680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.740431 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:42.740866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:42.874280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:42.880764 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-73f34761-a462-4175-808a-0c118a481ac9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.152542 Jun 02 10:22:42.881329 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 441/871] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:42 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:43.259028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b9d213bd-2c75-49b9-b19d-615dcc9c2517 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.045518 Jun 02 10:22:43.259639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 431/872] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 2 10:22:42 2022] POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments => generated 188 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 02 10:22:43.378408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:43.378909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:43.384991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:43.385447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:43.386209 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:43.386687 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:43.898099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:43.898636 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:43.905112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:43.905559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:43.906316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:43.906752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:44.033776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:44.041624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-81fa9b6f-6e12-456f-8bdb-9f582328237f tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.147444 Jun 02 10:22:44.042161 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 432/873] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:43 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:44.773156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c471cc3f-352c-434d-9aa6-ceb21b49a4b2 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments/f06c56a4-2ae9-481f-92d1-cd2838ff72df" status: 202 len: 0 microversion: 2.20 time: 1.399260 Jun 02 10:22:44.773737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 442/874] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 2 10:22:43 2022] DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments/f06c56a4-2ae9-481f-92d1-cd2838ff72df => generated 0 bytes in 1401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:22:44.827790 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:44.828354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:44.834334 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:44.834781 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:44.835578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:44.836009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:45.033640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b4adcd7d-5d6c-4ab5-85e3-734caa473c33 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/action" status: 202 len: 0 microversion: 2.20 time: 0.209727 Jun 02 10:22:45.034288 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 433/875] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 2 10:22:44 2022] POST /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:22:45.042262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:45.042896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:45.049800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:45.050248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:45.051008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:45.051507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:45.058037 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:45.058666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:45.064774 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:45.065234 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:45.066015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:45.066996 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:45.189776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:45.198921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:45.200829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:45.202092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bab55f01-f72f-423b-8334-efedb8f1810e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1672 microversion: 2.20 time: 0.163713 Jun 02 10:22:45.207192 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 443/876] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:45 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:45.207374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:45.212644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f92ea724-2972-4a73-b5f0-2fdb9bf53b74 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.158822 Jun 02 10:22:45.213230 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 434/877] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:45 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:46.220381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:46.221092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:46.227988 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:46.228445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:46.229316 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:46.229415 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:46.229817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:46.230044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:46.237196 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:46.237645 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:46.238532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:46.238976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:46.361208 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:46.369214 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:46.370724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:46.371927 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c9a77b56-ebea-4ac4-8196-b894a48bc8be tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1672 microversion: 2.20 time: 0.155600 Jun 02 10:22:46.372811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 444/878] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:46 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:46.375497 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:46.384246 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-69003709-2218-4e5b-808c-a888fb1af9b3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.158572 Jun 02 10:22:46.384805 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 435/879] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:46 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:47.390572 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:47.391225 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:47.398792 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:47.400849 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:47.401306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:47.401756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:47.402061 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:47.402178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:47.409323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:47.409810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:47.410661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:47.411125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:47.616394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:47.627533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-46d8c7e4-e22a-4e2c-ab4a-e963668b0105 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.230173 Jun 02 10:22:47.631190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:47.638492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 436/880] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:47 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:47.640831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:47.642363 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:47.643905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-85eb9248-7c1d-481a-9ac2-cb7038408705 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.257456 Jun 02 10:22:47.644529 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 445/881] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:47 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:48.651981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:48.652813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:48.654527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:48.658492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:48.674569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:48.675330 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:48.675483 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:48.676424 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:48.676548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:48.678222 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:48.679259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:48.689475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:48.738073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:22:48.932251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:48.942612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-736aeca8-c033-427e-b589-eea96145d2ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.300729 Jun 02 10:22:48.943558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 437/882] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:48 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:48.964181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-f77ba52f-53a6-4b61-874c-75057682421d req-9cee2803-be5a-470a-ad66-b06bc7cf360d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:48.975464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-f77ba52f-53a6-4b61-874c-75057682421d req-9cee2803-be5a-470a-ad66-b06bc7cf360d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:48.976401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-f77ba52f-53a6-4b61-874c-75057682421d req-9cee2803-be5a-470a-ad66-b06bc7cf360d service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:48.980777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:48.989197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-f77ba52f-53a6-4b61-874c-75057682421d req-9cee2803-be5a-470a-ad66-b06bc7cf360d service nova] Creating event network-changed:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:22:48.994527 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-f77ba52f-53a6-4b61-874c-75057682421d req-9cee2803-be5a-470a-ad66-b06bc7cf360d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049225 Jun 02 10:22:48.995465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 438/883] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:22:49.019446 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:49.021881 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:49.028984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.029713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:49.030606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.031180 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:49.096546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f95e05f5-a67c-4b82-a1ab-04a7906ed729 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 204 len: 0 microversion: 2.1 time: 0.451060 Jun 02 10:22:49.097386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 446/884] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:22:48 2022] DELETE /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:22:49.107716 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:49.109442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:49.124837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.125697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:49.132120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.132811 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:49.262823 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:49.276573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:49.278377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:49.279964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5cc822ba-6c0b-42f7-aed2-a54d71a3afd6 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.283202 Jun 02 10:22:49.280813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 439/885] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:48 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:49.313647 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:49.322578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bc81eaf5-fc34-4100-9ebd-a1e5592cf833 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.220628 Jun 02 10:22:49.333342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 447/886] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:49 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:49.960411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:49.961019 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:49.967488 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.967934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:49.968689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:49.969121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:50.098265 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:50.106121 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c01e3feb-867d-44d6-b10a-5813f2bacc68 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.149539 Jun 02 10:22:50.106768 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 440/887] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:49 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:50.298401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:50.298949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:50.305518 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:50.305962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:50.306739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:50.307218 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:50.349366 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:50.352523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:50.372437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:50.372930 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:50.373748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:50.374188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:50.467700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:50.482526 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:50.484093 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:50.485480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f73507e0-cc7e-4866-9ce9-2dfdd64ceb79 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.190922 Jun 02 10:22:50.486203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 448/888] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:50 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:50.528673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:50.536156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-aada6008-f4b3-4da4-ac18-0636be917dfd tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.197657 Jun 02 10:22:50.536717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 441/889] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:50 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:51.140420 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:51.141295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:51.147747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.148510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.149540 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.150218 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.154963 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:51.285605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:51.294284 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9f21f98f-ed49-4761-8397-47ab19cb0290 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.157628 Jun 02 10:22:51.296600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 449/890] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:51 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:51.502904 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:51.503477 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:51.510060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.510516 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.511332 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.511777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.553270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:51.553881 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:51.560731 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.561183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.561962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:51.562401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:51.656163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:51.665802 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:51.667361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:51.668717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f09548f9-ce9b-49e4-81a8-802cb33865b0 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.169757 Jun 02 10:22:51.669225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 442/891] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:51 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:22:51.744984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:51.754480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-021f4988-45db-4d51-904c-d78596e63efc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.204792 Jun 02 10:22:51.765003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 450/892] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:51 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:52.314004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:52.314940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:52.321065 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.321518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.322287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.322724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.458090 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:52.466021 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1c870593-3b0e-433c-b3a4-af0ce0fe259c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.157310 Jun 02 10:22:52.466588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 443/893] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:52 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:52.687201 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:52.687929 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:52.695060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.695536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.696303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.696740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.772964 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:52.773622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:52.789844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.790412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.791423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:52.791873 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:52.841049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:52.849700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:52.851306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:52.852494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b7f5ec2c-13fe-4c70-a56b-e617a3ea3af3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.169911 Jun 02 10:22:52.863085 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 451/894] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:52 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:52.958012 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:52.966230 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-88c73208-4126-4c3e-8e51-5e1bd6f9c120 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.197235 Jun 02 10:22:52.967486 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 444/895] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:52 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:53.483632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:53.484242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:53.490230 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.490683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:53.491470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.491907 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:53.642453 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:53.650718 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3b8065da-e0a0-4fbe-bd60-e5d2754fbef6 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.171166 Jun 02 10:22:53.661135 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 452/896] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:53 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:53.870649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:53.871211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:53.880606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.881054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:53.881868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.882480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:53.984013 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:53.984815 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:53.991881 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.992337 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:53.993107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:53.993545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:54.017738 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:54.038407 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:54.040081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:54.041302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-63b7edd9-77a2-4fdf-bf7c-6dea739cb59a tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.175353 Jun 02 10:22:54.044543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 445/897] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:53 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:54.132812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:54.141020 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-43e6cb0d-c0f6-4ff4-a954-23efa559b0d4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.161056 Jun 02 10:22:54.142025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 453/898] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:53 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:54.669488 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:54.670202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:54.677436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:54.677954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:54.678924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:54.679577 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:54.820663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:54.828569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-910721a9-b9f2-48d5-9f0d-5ad962181070 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.163046 Jun 02 10:22:54.832965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 446/899] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:54 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:54.952944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1469123998", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1204552918", "security_groups": [{"name": "tempest-secgroup-smoke-1262281755"}], "block_device_mapping_v2": [{"uuid": "584c0bc2-5810-4ded-8a1b-9252e1bb6528", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "49c7bda1-edb9-41b1-8d14-2f7579277ee0"}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:22:55.061148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:55.061765 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:55.068834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.069290 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.070066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.070520 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.071957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] validate_networks() for [('49c7bda1-edb9-41b1-8d14-2f7579277ee0', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:22:55.216613 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:55.226837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:55.228776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:55.230246 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5fc9dd09-dcfb-4dfb-8ca7-bdef344f5a3f tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.173077 Jun 02 10:22:55.231127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 447/900] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:55 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:22:55.247181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:55.248016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:55.255122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.255598 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.256702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.256825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.393175 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:55.401222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-e4ec35ce-d013-49f9-a5ac-78342f7ed0fb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.157870 Jun 02 10:22:55.401810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 448/901] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:55 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:55.480864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:22:55.481287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:22:55.481758 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:22:55.482406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:22:55.482842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:22:55.491686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.492131 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.492915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.493348 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.509941 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:22:55.514271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Getting quotas for user 722fc8b42ea941499a56937ce0d8ad3a and project 21c0abf697ed4e29870a594ed83de6c7. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:22:55.578265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:22:55.581037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='584c0bc2-5810-4ded-8a1b-9252e1bb6528',volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:22:55.845731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:55.849431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:55.852584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.853038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.853807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:55.854251 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:55.959918 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a4241b8b-f3ba-4dd0-97d8-9e242364794b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.007542 Jun 02 10:22:55.963312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 454/902] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:22:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:22:55.968611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4ccca807-b9ab-4c3e-88d9-d2d3b1091ce3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:55.969330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4ccca807-b9ab-4c3e-88d9-d2d3b1091ce3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:56.015284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.029875 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4ccca807-b9ab-4c3e-88d9-d2d3b1091ce3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.036703 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6f5b0697-d57d-4a94-aefe-f125442e6504 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.194794 Jun 02 10:22:56.037627 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 449/903] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:55 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:56.048136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4ccca807-b9ab-4c3e-88d9-d2d3b1091ce3 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1095 microversion: 2.1 time: 0.082977 Jun 02 10:22:56.048975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 455/904] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:55 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1095 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:56.249356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:56.250563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:56.257438 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:56.257891 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:56.258674 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:56.259131 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:56.408027 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.419182 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:56.420802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:56.428660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.430823 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.431930 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:56.432438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:56.432602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f3299f0f-f9f1-4e8d-9aaa-11ce62d68bdc tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.187249 Jun 02 10:22:56.433145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 450/905] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:56 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:56.437939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:56.438428 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:56.589202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:56.599006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e403bf51-f408-458e-a23b-593f6264a8eb tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.184402 Jun 02 10:22:56.599705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 456/906] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:56 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:57.055055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:57.055694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:57.061976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.062441 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.063719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.064160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.066021 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:57.066711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:57.074578 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.076883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.076883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.076883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.183399 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.191779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a54cae1b-a3d5-4b94-a114-b03cc71f20c2 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.130559 Jun 02 10:22:57.192468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 457/907] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:57 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:22:57.200099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.208798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9251cf2a-030a-4e71-b8a7-345dfac3a954 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.158729 Jun 02 10:22:57.209363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 451/908] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:57 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:57.449826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:57.450376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:57.456810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.457268 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.458051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.458485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.595121 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.603289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.609102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.609102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c685e7d7-63af-4f4d-8259-0cbc80be9009 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.160088 Jun 02 10:22:57.609102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 458/909] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:57 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:57.616352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:57.616965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:57.624016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.624473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.625259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:57.626273 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:57.770130 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:57.777681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-550eaf4f-92f6-4ff7-997e-6548aadf87ba tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.165131 Jun 02 10:22:57.778244 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 452/910] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:57 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:58.208724 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:58.209644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:58.216599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.218729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.218729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.218729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.226702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:58.227894 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:58.235406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.236018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.237259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.237259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.351373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.362817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ab144556-521f-49b4-95ce-f71504f6e1b6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.157673 Jun 02 10:22:58.364137 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 459/911] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:58 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:58.436661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.445681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dcf3286a-daa4-4677-843c-e1ca359536c3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.223181 Jun 02 10:22:58.446298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 453/912] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:58 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:58.627373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:58.628280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:58.634701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.635219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.636035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.636614 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.780187 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.788213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.789871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.791060 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-40beb2c3-ee39-4eca-a882-46529175e869 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.169357 Jun 02 10:22:58.795310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:58.796654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:58.803741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 460/913] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:58 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:58.804537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.804999 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.805814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:58.806291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:58.946612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:58.954119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9e0fd78d-8f4a-417a-8245-fb0d0e64ebf4 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.162811 Jun 02 10:22:58.954683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 454/914] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:58 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:59.380464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:59.381073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:59.387501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.387944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.388698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.389129 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.448443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:59.456321 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9475ad80-b421-47db-b496-2158aad5d5dd tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.080397 Jun 02 10:22:59.456879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 461/915] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:59 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:59.463588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:59.464304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:59.470354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.470804 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.471598 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.472041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.491275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:59.648436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:59.656283 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6dc068b9-3921-44ae-aa82-445d06efb42e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.196502 Jun 02 10:22:59.656841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 455/916] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:59 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:22:59.809245 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:59.810501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:59.817155 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.817615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.818382 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.818827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.951075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:59.958943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:59.960476 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:22:59.961628 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-49702811-3542-4338-8315-ae2959641fa3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.156285 Jun 02 10:22:59.962188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 462/917] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:22:59 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:22:59.970743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:22:59.971394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:22:59.977785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.978239 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:22:59.979013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:22:59.979490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.112809 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:00.120404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-586f6647-4b28-481b-be52-42cec6998348 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.154032 Jun 02 10:23:00.121043 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 456/918] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:22:59 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:00.473600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:00.474127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:00.480562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.481009 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.481757 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.482448 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.542003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:00.549357 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8b1c1cdb-4013-442c-a1b6-f785a9b3ec9f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.080251 Jun 02 10:23:00.549910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 463/919] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:00 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:00.673077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:00.673701 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:00.679953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.680440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.681214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.681658 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.808625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:00.816968 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-90bc0952-687a-4692-b1a9-da1c34776ac5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.147986 Jun 02 10:23:00.817535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 457/920] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:00 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:00.980052 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:00.980664 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:00.987592 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.988044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:00.988820 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:00.989259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.116238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.124075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.125565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.126713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e9f0acc5-a09a-4131-807b-242efd6531b5 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.150721 Jun 02 10:23:01.127289 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 464/921] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:00 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:01.137249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:01.137895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:01.144826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.145276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.146042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.146677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.283924 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.291681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a89b664a-c7f7-42fb-90e1-c32c410108b3 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.158275 Jun 02 10:23:01.292254 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 458/922] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:01 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:01.566202 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:01.566818 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:01.573312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.573769 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.574539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.574987 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.637508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.645586 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-783edd3d-779d-441d-9f15-9e96fdfd9006 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.083724 Jun 02 10:23:01.646151 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 465/923] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:01 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:01.833680 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:01.834229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:01.840300 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.840757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.841561 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:01.842000 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:01.971803 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:01.979723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a5fe11d4-2263-4c1d-ac05-08aa7fd591e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.149987 Jun 02 10:23:01.980294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 459/924] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:01 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:02.144559 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:02.145103 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:02.151080 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.151565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.152332 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.152774 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.281644 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:02.290313 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:02.291921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:02.293116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-746ed1cd-06db-4bc0-8629-6e7f32d0aa0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.152510 Jun 02 10:23:02.293670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 466/925] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:02 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:02.308589 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:02.309439 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:02.316158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.319810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.319810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.319810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.449110 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:02.457152 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-37b16fb3-84b3-4a4d-b01a-2b9f62713ff2 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.152361 Jun 02 10:23:02.457723 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 460/926] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:02 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:02.662306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:02.664239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:02.669092 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.669544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.670371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:02.670807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:02.688426 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:02.731466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:02.738847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bbf8e311-1b79-41e6-af52-41e48878c34f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1145 microversion: 2.1 time: 0.081086 Jun 02 10:23:02.739442 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 467/927] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:02 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:02.997299 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:02.997831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:03.004383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.004831 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.005587 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.006027 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.141817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.149785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d483224e-4c9a-4ad1-ab72-e44ccc555600 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1725 microversion: 2.1 time: 0.156413 Jun 02 10:23:03.154159 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 461/928] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:02 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:03.311814 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:03.312431 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:03.318600 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.319054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.319864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.320354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.451715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.460240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.461745 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.462968 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-61dae7ac-c168-4ccb-b016-3497778aaaab tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.155206 Jun 02 10:23:03.463562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 468/929] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:03 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:03.474552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:03.475215 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:03.481884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.482584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.483390 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.483830 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.612395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.619871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9bbfd646-f63a-4ee4-93ba-19048b830219 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.149885 Jun 02 10:23:03.620433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 462/930] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:03 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:03.756021 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:03.756636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:03.763555 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.764054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.765049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:03.765514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:03.843394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:03.851446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-98c0bd53-bf39-468a-981f-0668ae6bc93f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1137 microversion: 2.1 time: 0.099878 Jun 02 10:23:03.852807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 469/931] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:03 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1137 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:04.167821 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:04.168424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:04.174793 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.175274 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.176033 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.176469 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.379177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.389515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-deb67669-2f7e-4e14-bb6c-cc01a53364eb tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1702 microversion: 2.1 time: 0.225525 Jun 02 10:23:04.390145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 463/932] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:04 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1702 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:04.407634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9a9aaf12-7190-4424-8ec3-f73db85a968e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:04.413765 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a9aaf12-7190-4424-8ec3-f73db85a968e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.414215 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9a9aaf12-7190-4424-8ec3-f73db85a968e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.475625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9a9aaf12-7190-4424-8ec3-f73db85a968e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Going to try to start instance {{(pid=118066) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 10:23:04.480289 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:04.480900 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:04.487593 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.488042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.488814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.489257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.628139 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.636762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.638273 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.639524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1dece528-18f3-4a10-ae12-106318f44727 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.163006 Jun 02 10:23:04.640117 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 464/933] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:04 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:23:04.644959 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:04.645564 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:04.651603 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.652100 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.652874 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.653317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.674194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9a9aaf12-7190-4424-8ec3-f73db85a968e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action" status: 202 len: 0 microversion: 2.1 time: 0.271895 Jun 02 10:23:04.674994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 470/934] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:23:04 2022] POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:23:04.683652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:04.684676 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:04.690590 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.691733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.692549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.692990 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.785081 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.792776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a6d667d7-7c5d-4bd2-b887-933c96129774 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.151711 Jun 02 10:23:04.793352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 465/935] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:04 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:04.822161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.830089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bdad2dbb-d9c3-4131-968e-27925294e2b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1711 microversion: 2.1 time: 0.150456 Jun 02 10:23:04.830648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 471/936] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:04 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:04.869467 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:04.870080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:04.876114 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.876565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.877343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:04.877761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:04.936857 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:04.944744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1bba0411-674c-4945-a688-2fae3f8ce3f6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1193 microversion: 2.1 time: 0.079036 Jun 02 10:23:04.945312 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 466/937] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:04 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:05.657366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:05.657978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:05.660551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:05.665488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.665941 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.666697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.667169 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.798080 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:05.806238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:05.815700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:05.815700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-63e671ee-ef23-466e-a02e-9e026ed09be7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.155538 Jun 02 10:23:05.815700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 472/938] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:05 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:05.816618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:05.816618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:05.817951 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.818405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.819223 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.819668 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.847281 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:05.848006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:05.854056 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.854502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.855370 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.855802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.952913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:05.961138 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-727650d9-4847-4203-8df5-d85f6bca83cc tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.155041 Jun 02 10:23:05.961715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 467/939] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:05 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:05.966120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:05.966725 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:05.972665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.973125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.973901 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:05.974340 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:05.986022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:05.994096 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c35cb8c4-afd8-4162-b9aa-c15943031ce9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1711 microversion: 2.1 time: 0.150847 Jun 02 10:23:05.994943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 473/940] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:05 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:06.035126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:06.042383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-791bfab6-aa29-4894-aa09-d1760e6d39cf tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1193 microversion: 2.1 time: 0.079731 Jun 02 10:23:06.042953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 468/941] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:05 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:06.827665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:06.828281 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:06.831034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=8 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:06.832208 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:06.837873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:06.841160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:06.841160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:06.841160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:06.976779 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:06.978747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:06.979284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:06.985777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:06.986084 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:06.986420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:06.987213 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:06.987650 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:06.988113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:06.989434 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-57496c7d-678f-41bb-900f-af6e19e35a74 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.165883 Jun 02 10:23:06.995460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 474/942] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:06 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:07.012760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:07.013514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:07.020164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:07.020650 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:07.021422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:07.021864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:07.125601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:07.133349 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d3997f42-dcea-437a-a103-243e7e55af3b tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1570 microversion: 2.1 time: 0.158714 Jun 02 10:23:07.133919 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 469/943] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:06 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:07.141228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:07.141907 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:07.148562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:07.149016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:07.149920 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:07.150214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:07.152798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:07.170186 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-573a12eb-13c3-4047-a3fd-03c716c7f7d1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1711 microversion: 2.1 time: 0.162208 Jun 02 10:23:07.172104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 475/944] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:07 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:07.243028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:07.253196 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6832550c-415c-4b93-a997-29888800ff2c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1193 microversion: 2.1 time: 0.115005 Jun 02 10:23:07.259601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 470/945] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:07 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:08.007829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:08.008435 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:08.015439 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.015895 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.017036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.017487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.150898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:08.151591 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:08.158512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.158655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.159472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.160078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.231556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.240080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-15e69cc0-f7ec-46a8-a48a-a78b5e5fc669 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1383 microversion: 2.1 time: 0.093257 Jun 02 10:23:08.240807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 471/946] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:08 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1383 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:08.246209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:08.247051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:08.253956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.254573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.258507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.258507 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.259685 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.260977 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:08.278700 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.294375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.294375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e0c1909d-7781-4fc1-ad8b-627d523487a9 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.288466 Jun 02 10:23:08.294375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 476/947] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:08 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:08.308367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:08.308991 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:08.332328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.332328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.332328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.332328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.410503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.419330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9cd9041e-60fc-4116-9a21-3146108259f9 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1211 microversion: 2.1 time: 0.124086 Jun 02 10:23:08.419997 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 477/948] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:08 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:08.424975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-cb5af469-9c36-478c-bfcd-5f6bc2fb206d req-77e6b8f8-f0b3-4c1c-8530-022e62a54746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5999b411-b480-47b2-bcf8-5893bf9952ae", "name": "network-vif-deleted", "tag": "849ed94f-bd45-4661-ae07-9100307ec316"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:08.434599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-cb5af469-9c36-478c-bfcd-5f6bc2fb206d req-77e6b8f8-f0b3-4c1c-8530-022e62a54746 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:08.440272 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-cb5af469-9c36-478c-bfcd-5f6bc2fb206d req-77e6b8f8-f0b3-4c1c-8530-022e62a54746 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:08.448299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-cb5af469-9c36-478c-bfcd-5f6bc2fb206d req-77e6b8f8-f0b3-4c1c-8530-022e62a54746 service nova] Creating event network-vif-deleted:849ed94f-bd45-4661-ae07-9100307ec316 for instance 5999b411-b480-47b2-bcf8-5893bf9952ae on hv-cinder-79760 Jun 02 10:23:08.453701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-cb5af469-9c36-478c-bfcd-5f6bc2fb206d req-77e6b8f8-f0b3-4c1c-8530-022e62a54746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Jun 02 10:23:08.454370 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 478/949] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:08.748154 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:08.760836 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8b967fcb-e61b-4d36-b22e-224aec2ca204 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1711 microversion: 2.1 time: 0.518248 Jun 02 10:23:08.761766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 472/950] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:08 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1711 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:09.258431 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:09.259311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:09.266402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.266879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.267683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.268156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.309916 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:09.310528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:09.313224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=94 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:09.318731 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.319276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.320068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.320513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.332798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:09.341443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-16eed13f-40dd-42c5-9932-dfd01ca23b12 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1219 microversion: 2.1 time: 0.088032 Jun 02 10:23:09.342108 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 479/951] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:09 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:09.436784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:09.438078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:09.446505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.447153 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.448217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.448805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.533442 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:09.544797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:09.549237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:09.551361 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-adbaf091-8e0a-42b3-9371-e92d2ca7b26d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.245459 Jun 02 10:23:09.553010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 473/952] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:09 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:23:09.660621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:09.668763 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a7a4d76e-958e-4bae-b173-bfc2bdc36df6 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1279 microversion: 2.1 time: 0.236109 Jun 02 10:23:09.669737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 480/953] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:09 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:09.779714 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:09.780485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:09.789082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.796746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.796746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:09.796746 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:09.994309 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.005371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-aab9b59f-ca1c-42d1-9ff0-978ea3052f31 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1715 microversion: 2.1 time: 0.228620 Jun 02 10:23:10.005371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 474/954] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:09 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1715 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:10.358483 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:10.359417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:10.369159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.369612 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.370401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.370833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.405503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.406002 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.406560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lazy-loading 'fault' on Instance uuid 5999b411-b480-47b2-bcf8-5893bf9952ae {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:23:10.450311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929db9b6452f46ff9b854efb4a0d464a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520be3417a7047ef81cac4db926f3f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.458766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a6d8382a-25b0-4917-a8ef-db5b1531be5e tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 200 len: 1224 microversion: 2.1 time: 0.104672 Jun 02 10:23:10.459368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 481/955] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:10 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:10.513003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-a493acf3-dbfa-49cf-b17c-2346d8943ee2 req-9666c5d2-15e5-4be8-9d2c-00b3f9fe8676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922fc677-740c-48fa-8361-883992d8b050", "tag": "2eba471d-644b-4156-9829-2bffb764f522"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:10.522661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-a493acf3-dbfa-49cf-b17c-2346d8943ee2 req-9666c5d2-15e5-4be8-9d2c-00b3f9fe8676 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.523124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-a493acf3-dbfa-49cf-b17c-2346d8943ee2 req-9666c5d2-15e5-4be8-9d2c-00b3f9fe8676 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.534614 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-a493acf3-dbfa-49cf-b17c-2346d8943ee2 req-9666c5d2-15e5-4be8-9d2c-00b3f9fe8676 service nova] Creating event network-changed:2eba471d-644b-4156-9829-2bffb764f522 for instance 922fc677-740c-48fa-8361-883992d8b050 on hv-cinder-79760 Jun 02 10:23:10.539401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-a493acf3-dbfa-49cf-b17c-2346d8943ee2 req-9666c5d2-15e5-4be8-9d2c-00b3f9fe8676 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029994 Jun 02 10:23:10.542406 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 475/956] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:10.571484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:10.572361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:10.578646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.579107 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.579925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.580364 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.686467 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:10.687218 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:10.694531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.695267 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.696216 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:10.697883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:10.735147 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.744461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.745957 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.747148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0404e256-6986-4032-a6f5-0c01e4a28253 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.180089 Jun 02 10:23:10.747714 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 482/957] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:10 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:10.839492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:10.847155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-76dc4d5d-bebc-414c-a582-2f9a01f1be5f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.164891 Jun 02 10:23:10.850478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 476/958] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:10 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:11.476455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:11.477076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] [instance: 5999b411-b480-47b2-bcf8-5893bf9952ae] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:11.483869 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.484355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.485134 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.485574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.500197 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] HTTP exception thrown: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Request method failure captured: Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae HTTP/1.1 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI4F73ptZ2NgGBy5DeCiQojwJYg6bG4Q3SCdXqvcQxIzyLjNYgLkONqEaDCpkO8JWgRqdVOme-c7DAo6kaaH-2u4KXGOpI36nQv28xeGVxS2SNopmvwnYARPIYGijVsOrz_9MfhMeJ6Hs15RIgYmBxxY1WjMKnGDyZIAyxhf2zJN-Sk Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 520be3417a7047ef81cac4db926f3f20 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-TestShelveInstance-1133967957 Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:11.501893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/520be3417a7047ef81cac4db926f3f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_520be3417a7047ef81cac4db926f3f20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/520be3417a7047ef81cac4db926f3f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/520be3417a7047ef81cac4db926f3f20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-TestShelveInstance-1133967957 Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 520be3417a7047ef81cac4db926f3f20 Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-TestShelveInstance-1133967957 Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-TestShelveInstance-1133967957-project Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 929db9b6452f46ff9b854efb4a0d464a Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-TestShelveInstance-1133967957-project Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. Jun 02 10:23:11.503314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '5999b411-b480-47b2-bcf8-5893bf9952ae'} Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:11.504112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. Jun 02 10:23:11.505389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:11.506535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Returning 404 to user: Instance 5999b411-b480-47b2-bcf8-5893bf9952ae could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:11.506535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e3064d76-fe65-46c5-839d-b1e67980ae98 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae" status: 404 len: 111 microversion: 2.1 time: 0.031423 Jun 02 10:23:11.506535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 483/959] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:11 2022] GET /compute/v2.1/servers/5999b411-b480-47b2-bcf8-5893bf9952ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:11.611721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-52aa6822-794f-4766-b115-8a7d4e0b752a req-7015db93-a978-4752-be76-78a24741f6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "name": "network-vif-plugged", "status": "completed", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:11.622142 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-52aa6822-794f-4766-b115-8a7d4e0b752a req-7015db93-a978-4752-be76-78a24741f6cc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.622729 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-52aa6822-794f-4766-b115-8a7d4e0b752a req-7015db93-a978-4752-be76-78a24741f6cc service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.634241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-52aa6822-794f-4766-b115-8a7d4e0b752a req-7015db93-a978-4752-be76-78a24741f6cc service nova] Creating event network-vif-plugged:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:23:11.639398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-52aa6822-794f-4766-b115-8a7d4e0b752a req-7015db93-a978-4752-be76-78a24741f6cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035997 Jun 02 10:23:11.639997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 477/960] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:11.766923 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:11.767830 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:11.774471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.775016 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.776155 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.777263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.791321 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-479075df-3b15-4687-af58-5440112098c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] Calling method '.version_select at 0x7f49ddf1de50>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:11.797718 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:11.929892 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-479075df-3b15-4687-af58-5440112098c5 tempest-TestShelveInstance-1133967957 tempest-TestShelveInstance-1133967957-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-307942013" status: 202 len: 0 microversion: 2.1 time: 0.143034 Jun 02 10:23:11.930478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 478/961] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-307942013 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:23:11.936376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:11.937390 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:11.943880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.944548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.945317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:11.945761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:11.952173 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:11.970073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:11.972530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:11.974019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8462f3bd-dfc8-4e8a-b59a-a5e7828c88cf tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.212084 Jun 02 10:23:11.975327 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 484/962] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:11 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:12.126992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:12.135233 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a596f48e-a0e6-43ec-83a7-c415932d258a tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.203485 Jun 02 10:23:12.135826 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 479/963] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:11 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:12.993419 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:12.994059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:13.001326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:13.001785 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:13.002553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:13.002995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:13.151794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:13.152509 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:13.159202 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:13.159735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:13.160605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:13.161120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:13.178295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:13.189185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:13.191739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:13.193089 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c0332b45-5682-4504-8760-b254852c9455 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.203504 Jun 02 10:23:13.198233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 485/964] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:12 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:13.331942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:13.339735 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9d800559-3b87-4d24-b2f6-8d6b40b8fa1d tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.191755 Jun 02 10:23:13.340655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 480/965] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:13 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:14.211791 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:14.212404 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:14.219075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:14.219554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:14.220513 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:14.221117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:14.361618 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:14.362711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:14.368830 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:14.375944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:14.377704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:14.378921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:14.379748 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:14.379903 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:14.380551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:14.381611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4b7dea82-2cac-4f36-9afa-7f0d9a739e4e tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.173704 Jun 02 10:23:14.382248 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 486/966] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:14 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:14.637738 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:14.645547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9d2318a9-2f4d-4367-8f95-de9d13e4f774 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.292201 Jun 02 10:23:14.646125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 481/967] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:14 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:15.401497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:15.402689 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:15.416229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:15.416906 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:15.417824 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:15.418354 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:15.661662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:15.662398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:15.668551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:15.669803 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:15.670275 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:15.671065 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:15.671542 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:15.677300 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:15.679181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:15.680665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f51c34ac-c01d-4d65-b496-aff0fdf3c4aa tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1730 microversion: 2.20 time: 0.284375 Jun 02 10:23:15.681223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 487/968] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:15 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1730 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 02 10:23:15.838722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:15.846513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-17e3a7c4-cbeb-491c-b9b9-de1cc0087d82 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.188718 Jun 02 10:23:15.847112 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 482/969] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:15 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:16.700164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:16.700715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:16.707755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:16.708205 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:16.708967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:16.709412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:16.846124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:16.855608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:16.858213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:16.863293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:16.863911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:16.867543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f8e3d4a3-0d86-49ae-b385-34a073611764 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1717 microversion: 2.20 time: 0.162523 Jun 02 10:23:16.870895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:16.871756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 488/970] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:23:16 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1717 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:23:16.872702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:16.873737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:16.874383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:17.098906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:17.106871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b9ec8196-a6ac-4ab7-9f8d-6c2b368af712 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.247125 Jun 02 10:23:17.107693 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 483/971] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:16 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:17.210014 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:17.210507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:17.219043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:17.226410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:17.226410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:17.226410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:17.249759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d22b2264-6762-425a-a2c7-3dc00744e701 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/ips" status: 200 len: 150 microversion: 2.1 time: 0.044124 Jun 02 10:23:17.250535 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 489/972] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:23:17 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:18.124198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:18.125498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:18.133034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:18.133752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:18.134540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:18.134984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:18.337456 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:18.344997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0d39856a-a7aa-4501-9776-36c6c4e53214 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.225103 Jun 02 10:23:18.345572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 484/973] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:18 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:19.362077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:19.363469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:19.370299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:19.372423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:19.372423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:19.372423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:19.522130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:19.529864 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ae26a016-13c7-4d66-8214-779b434aff35 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.171603 Jun 02 10:23:19.530532 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 490/974] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:19 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:19.900331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c4c79ad-0ca9-40d9-8e82-395a6b367220"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:19.901385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:19.908040 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:19.908368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:19.909910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:19.910339 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:20.547167 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:20.547804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:20.554630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:20.555076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:20.555856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:20.556293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:20.601940 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8e5d9e3f-bac9-4dfd-b425-c336e1c878bc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "POST /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705288 Jun 02 10:23:20.603744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 485/975] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:23:19 2022] POST /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:20.696585 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:20.705562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-38825297-4850-47b5-a497-fb77120b87f4 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.161886 Jun 02 10:23:20.707387 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 491/976] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:20 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:23:21.723170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:21.723953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:21.730363 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:21.730824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:21.731878 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:21.732324 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:21.869003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:21.876866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2c37c7ff-cdc1-4d5c-bef2-2abdd103fd29 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.158560 Jun 02 10:23:21.877434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 486/977] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:21 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:22.893500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:22.894117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:22.900583 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:22.901039 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:22.901810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:22.902253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:23.031980 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:23.039962 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6b923df2-9182-4526-aab4-b46ac8abdd52 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.150354 Jun 02 10:23:23.040525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 492/978] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:22 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:23.683824 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-993f54d9-3a5f-4348-9d48-c6c2b661ac3c req-546ffae9-d8f1-4780-9fe0-21056e4b06db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922fc677-740c-48fa-8361-883992d8b050", "name": "network-vif-plugged", "status": "completed", "tag": "2eba471d-644b-4156-9829-2bffb764f522"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:23.692561 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-993f54d9-3a5f-4348-9d48-c6c2b661ac3c req-546ffae9-d8f1-4780-9fe0-21056e4b06db service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:23.693010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-993f54d9-3a5f-4348-9d48-c6c2b661ac3c req-546ffae9-d8f1-4780-9fe0-21056e4b06db service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:23.703747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-993f54d9-3a5f-4348-9d48-c6c2b661ac3c req-546ffae9-d8f1-4780-9fe0-21056e4b06db service nova] Creating event network-vif-plugged:2eba471d-644b-4156-9829-2bffb764f522 for instance 922fc677-740c-48fa-8361-883992d8b050 on hv-cinder-79760 Jun 02 10:23:23.708939 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-993f54d9-3a5f-4348-9d48-c6c2b661ac3c req-546ffae9-d8f1-4780-9fe0-21056e4b06db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028958 Jun 02 10:23:23.709513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 487/979] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:24.056015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:24.056684 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:24.063228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:24.063683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:24.064531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:24.064976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:24.198637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:24.206190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c42084a6-fc64-4801-8e37-88a90f267c58 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.154048 Jun 02 10:23:24.206781 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 493/980] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:24 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:25.224640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:25.225331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:25.231884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:25.232325 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:25.233084 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:25.233547 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:25.364316 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:25.371840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3cbee0bb-c1bb-4278-a253-5587f1f7b853 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1267 microversion: 2.1 time: 0.152530 Jun 02 10:23:25.372401 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 488/981] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:25 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:26.389029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:26.389680 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:26.396789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:26.397239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:26.398030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:26.398466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:26.525916 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:26.533398 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0d4cac0f-8485-4b83-b775-241f093d6e36 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1454 microversion: 2.1 time: 0.148272 Jun 02 10:23:26.533967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 494/982] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:26 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:26.549934 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:26.550572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:26.557127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:26.557578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:26.558367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:26.558806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:26.690175 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:26.697616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-25cb0f5f-dd11-42e8-aabb-d1437901be1f tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1454 microversion: 2.1 time: 0.151905 Jun 02 10:23:26.698186 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 489/983] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:26 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:28.758200 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-0426fe96-ab45-4b26-b000-e3c32cb8e0eb req-705f6ffa-715e-4f78-a702-23b22add66ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922fc677-740c-48fa-8361-883992d8b050", "tag": "2eba471d-644b-4156-9829-2bffb764f522"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:28.766502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-0426fe96-ab45-4b26-b000-e3c32cb8e0eb req-705f6ffa-715e-4f78-a702-23b22add66ab service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:28.767152 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-0426fe96-ab45-4b26-b000-e3c32cb8e0eb req-705f6ffa-715e-4f78-a702-23b22add66ab service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:28.777785 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-0426fe96-ab45-4b26-b000-e3c32cb8e0eb req-705f6ffa-715e-4f78-a702-23b22add66ab service nova] Creating event network-changed:2eba471d-644b-4156-9829-2bffb764f522 for instance 922fc677-740c-48fa-8361-883992d8b050 on hv-cinder-79760 Jun 02 10:23:28.782747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-0426fe96-ab45-4b26-b000-e3c32cb8e0eb req-705f6ffa-715e-4f78-a702-23b22add66ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028292 Jun 02 10:23:28.783554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 495/984] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:29.276245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:29.276747 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:29.284151 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:29.284678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:29.285445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:29.285888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:29.306073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:29.372145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'services' on Instance uuid 89c7abd6-91c7-4f08-bb0c-6a34db65a835 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:23:29.567598 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6b6b979d-edac-474a-b6b6-8e4ce1e5b37c tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments/8c4c79ad-0ca9-40d9-8e82-395a6b367220" status: 202 len: 0 microversion: 2.1 time: 0.295083 Jun 02 10:23:29.568210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 490/985] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:23:29 2022] DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments/8c4c79ad-0ca9-40d9-8e82-395a6b367220 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:23:29.577649 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:29.579000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:29.585502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:29.585983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:29.586752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:29.587217 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:29.629417 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9b5017cc-4b75-4653-bf76-d64564bf5ffb tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056407 Jun 02 10:23:29.629977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 496/986] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:23:29 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:30.642335 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:30.643431 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:30.650383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:30.650839 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:30.651640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:30.652083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:30.681395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-974e21cb-2cb4-4209-9987-273bd525d67e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 Jun 02 10:23:30.681962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 491/987] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:23:30 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:31.693821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:31.694746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:31.701271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:31.701726 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:31.702491 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:31.702927 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:31.732632 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-541eadd7-cf3d-47db-9c26-d66ac0db4501 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043482 Jun 02 10:23:31.733178 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 497/988] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:23:31 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:23:31.788528 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:31.789062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:31.795606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:31.796055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:31.796818 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:31.797260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:31.822395 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:23:32.081222 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ed663cf0-3ea3-4423-9b01-edbf5d8784ab tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 204 len: 0 microversion: 2.1 time: 0.296161 Jun 02 10:23:32.082359 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 492/989] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:23:31 2022] DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:23:32.090655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:32.097085 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:32.097412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:32.097870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:32.098643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:32.099088 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:32.228558 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:32.236574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e0b64a86-3f27-4831-a28f-ce60dcacd27f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1682 microversion: 2.1 time: 0.149820 Jun 02 10:23:32.237160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 498/990] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:32 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:33.254399 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:33.255164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:33.261839 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:33.262294 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:33.263137 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:33.263588 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:33.399130 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:33.406628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fb2b5a64-ca40-4731-a2d7-8d55e76bd627 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1682 microversion: 2.1 time: 0.156569 Jun 02 10:23:33.407383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 493/991] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:33 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:34.424005 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:34.427358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:34.431607 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:34.432051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:34.432852 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:34.433252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:34.564136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:34.571502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-909f2399-a284-4590-baad-3199dda26e30 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1682 microversion: 2.1 time: 0.151387 Jun 02 10:23:34.572072 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 499/992] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:34 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:35.174650 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-421c2ed8-981c-4f0e-847e-6dbfe8c2e5c3 req-c01032a8-e64b-400a-bb98-085fba89ec96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c7abd6-91c7-4f08-bb0c-6a34db65a835", "name": "network-vif-deleted", "tag": "e13b22ad-5ecd-4417-ba43-9edff7b31a75"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:35.183844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-421c2ed8-981c-4f0e-847e-6dbfe8c2e5c3 req-c01032a8-e64b-400a-bb98-085fba89ec96 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:35.186986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-421c2ed8-981c-4f0e-847e-6dbfe8c2e5c3 req-c01032a8-e64b-400a-bb98-085fba89ec96 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:35.196815 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-421c2ed8-981c-4f0e-847e-6dbfe8c2e5c3 req-c01032a8-e64b-400a-bb98-085fba89ec96 service nova] Creating event network-vif-deleted:e13b22ad-5ecd-4417-ba43-9edff7b31a75 for instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 on hv-cinder-79760 Jun 02 10:23:35.202655 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-421c2ed8-981c-4f0e-847e-6dbfe8c2e5c3 req-c01032a8-e64b-400a-bb98-085fba89ec96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031306 Jun 02 10:23:35.203565 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 494/993] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:35.587810 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:35.588440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:35.594955 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:35.595447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:35.596224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:35.596668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:35.628011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:35.629006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:35.629460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lazy-loading 'fault' on Instance uuid 89c7abd6-91c7-4f08-bb0c-6a34db65a835 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:23:35.669000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0514d3b22d94435196f8bf1eff26699e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea502039a02d4d5db21dcc41c98a52a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:23:35.676900 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-740092be-a469-4ece-ab7e-f0e12add723e tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 200 len: 1332 microversion: 2.1 time: 0.092966 Jun 02 10:23:35.677473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 500/994] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:35 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:23:36.694860 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:36.695599 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:36.702582 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:36.703071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:36.703885 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:36.704327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:36.719998 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 HTTP/1.1 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:36.721606 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:36.723042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '89c7abd6-91c7-4f08-bb0c-6a34db65a835'} Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:36.723883 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:36.725396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:36.726789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:36.726789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-21a732f7-ab1b-4284-974a-7fb59178d4e6 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 404 len: 111 microversion: 2.1 time: 0.032957 Jun 02 10:23:36.726789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 495/995] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:36 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:36.731918 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9a7dbfd-2ecf-4b88-9208-238aa9dc157d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '.version_select at 0x7f49ddf259d0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:36.735051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e9a7dbfd-2ecf-4b88-9208-238aa9dc157d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [be897507-ab90-4cc2-9b25-4306bbc54f68] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 10:23:37.742224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [None req-e9a7dbfd-2ecf-4b88-9208-238aa9dc157d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [be897507-ab90-4cc2-9b25-4306bbc54f68] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 50922. Jun 02 10:23:37.748714 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=58 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:37.825095 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e9a7dbfd-2ecf-4b88-9208-238aa9dc157d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062846397" status: 202 len: 0 microversion: 2.1 time: 1.097153 Jun 02 10:23:37.825735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 501/996] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 2 10:23:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062846397 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:23:39.715375 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:39.715898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:39.718286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:39.722988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:39.723464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:39.724214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:39.724646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:39.738024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 HTTP/1.1 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:39.739578 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.741143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '89c7abd6-91c7-4f08-bb0c-6a34db65a835'} Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:39.742158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.743637 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.745352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:39.745352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-da1c39c5-d6d7-4c3c-95d0-95902b1a0bdc tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 404 len: 111 microversion: 2.1 time: 0.029370 Jun 02 10:23:39.745352 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 496/997] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:23:39 2022] DELETE /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:39.749974 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:39.750589 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 89c7abd6-91c7-4f08-bb0c-6a34db65a835] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:39.758010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:39.758465 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:39.759251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:39.759695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:39.773086 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 HTTP/1.1 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:39.774709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.776341 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '89c7abd6-91c7-4f08-bb0c-6a34db65a835'} Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:39.777361 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. Jun 02 10:23:39.778827 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:39.780293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 89c7abd6-91c7-4f08-bb0c-6a34db65a835 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:39.780293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b2839cf2-3d6c-45c1-b4eb-f64174c5350f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835" status: 404 len: 111 microversion: 2.1 time: 0.030775 Jun 02 10:23:39.780293 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 502/998] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:39 2022] GET /compute/v2.1/servers/89c7abd6-91c7-4f08-bb0c-6a34db65a835 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:41.019110 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:41.019641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:41.027014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.027511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.029554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.029554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.042902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 HTTP/1.1 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:41.044512 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.046224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'c9d81486-ec35-4e30-914c-9c54e61ca205'} Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:41.049909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.051434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.054917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:41.054917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dbbdb11b-6cc0-476f-a870-5272f8a4517a tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jun 02 10:23:41.054917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 497/999] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:23:41 2022] DELETE /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:41.056506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:41.057123 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: c9d81486-ec35-4e30-914c-9c54e61ca205] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:41.063631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.064091 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.064858 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.065934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.069856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=100 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:41.079371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 HTTP/1.1 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:41.082203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.083896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'c9d81486-ec35-4e30-914c-9c54e61ca205'} Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:41.084898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. Jun 02 10:23:41.086701 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.088075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance c9d81486-ec35-4e30-914c-9c54e61ca205 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:41.088075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5d77a6d0-8339-4476-99cd-da7dccf7fd0d tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205" status: 404 len: 111 microversion: 2.1 time: 0.030273 Jun 02 10:23:41.088075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 503/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:41 2022] GET /compute/v2.1/servers/c9d81486-ec35-4e30-914c-9c54e61ca205 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:41.091416 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:41.091976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:41.098705 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.099181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.099954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.100398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.114018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 HTTP/1.1 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:41.115573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.117128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'b21e6592-8825-41a5-8feb-04019f190306'} Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:41.118015 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.119642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.121136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:41.121136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2625e05d-53e9-483f-9a0a-a40894a37b6f tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 404 len: 111 microversion: 2.1 time: 0.029552 Jun 02 10:23:41.121136 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 498/1001] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:23:41 2022] DELETE /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 10:23:41.125408 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:41.126038 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: b21e6592-8825-41a5-8feb-04019f190306] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:41.132925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.133379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.134150 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:41.134593 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:41.148340 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 HTTP/1.1 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:41.149840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.151396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'b21e6592-8825-41a5-8feb-04019f190306'} Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:41.152325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. Jun 02 10:23:41.153760 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:41.155148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance b21e6592-8825-41a5-8feb-04019f190306 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:41.155148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e9889b78-afcd-48c7-85d8-af81cf639d73 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jun 02 10:23:41.155148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 504/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:41 2022] GET /compute/v2.1/servers/b21e6592-8825-41a5-8feb-04019f190306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:42.480709 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:42.481492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:42.487994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:42.488446 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:42.489229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:42.489659 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:42.502660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb HTTP/1.1 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:42.504229 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.505829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '480d49c3-9724-40e7-a993-e9bf6ee926fb'} Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:42.506896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.508455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.510132 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:42.510132 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-59a61484-2ab6-4a26-8473-1bd8d21e7530 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 404 len: 111 microversion: 2.1 time: 0.029137 Jun 02 10:23:42.510132 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 499/1003] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:23:42 2022] DELETE /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:42.513871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:42.514487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] [instance: 480d49c3-9724-40e7-a993-e9bf6ee926fb] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:23:42.521539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:42.521996 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:42.522755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:23:42.523221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:23:42.537058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] HTTP exception thrown: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Request method failure captured: Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb HTTP/1.1 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI00w6We9TWB_ZWHAi4B7x44Re_H8cfWDmpAVrxtD6OqQs5x4MZwznKbsNgN_oWXYvh5cf1pXNI3RCsnX6vyRTRJJoiaiLuxyLmiXNJtqDb1fubncPAfauG9Q9L0u_7V7AvoQFdLngrCX0GqEK6HFRA-2CFRRCUGw-nZnsEMz03a_nI Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:42.538553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ea502039a02d4d5db21dcc41c98a52a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: ea502039a02d4d5db21dcc41c98a52a5 Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-870487565 Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 0514d3b22d94435196f8bf1eff26699e Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeNegativeTest-870487565-project Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.540358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '480d49c3-9724-40e7-a993-e9bf6ee926fb'} Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:42.541488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. Jun 02 10:23:42.542965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:42.544436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] Returning 404 to user: Instance 480d49c3-9724-40e7-a993-e9bf6ee926fb could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:42.544436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-08d390e1-d9c0-4cf7-be53-b64e2a0a7069 tempest-AttachVolumeNegativeTest-870487565 tempest-AttachVolumeNegativeTest-870487565-project] 10.222.0.13 "GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb" status: 404 len: 111 microversion: 2.1 time: 0.030049 Jun 02 10:23:42.544436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 505/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:23:42 2022] GET /compute/v2.1/servers/480d49c3-9724-40e7-a993-e9bf6ee926fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:48.058385 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-01428a92-6db2-45cd-a565-56ad8e055663 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Action: 'create', calling method: .version_select at 0x7f49ddfb6ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1978859451"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:48.755200 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-01428a92-6db2-45cd-a565-56ad8e055663 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.807626 Jun 02 10:23:48.755852 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 500/1005] 10.222.0.13 () {60 vars in 1154 bytes} [Thu Jun 2 10:23:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 02 10:23:48.766547 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c4b2c926-52e7-471d-a64b-b6e5bc871f82 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddeeddc0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:48.814533 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c4b2c926-52e7-471d-a64b-b6e5bc871f82 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 200 len: 345 microversion: 2.1 time: 0.051664 Jun 02 10:23:48.815117 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 506/1006] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:23:48 2022] GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:49.828368 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4d6112f0-68b0-4aa0-bf64-dceeda486340 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddfa4940>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:49.876517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4d6112f0-68b0-4aa0-bf64-dceeda486340 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 200 len: 346 microversion: 2.1 time: 0.052465 Jun 02 10:23:49.877076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 501/1007] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:23:49 2022] GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:49.889068 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-441c8792-f20c-4ddc-ab97-d5959f2cfb4c tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Action: 'create', calling method: .version_select at 0x7f49de95e1f0>, body: {"snapshot": {"volume_id": "453e2dc6-3a77-4e18-9354-d566d914ae66", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-901598135"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:23:50.277546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-441c8792-f20c-4ddc-ab97-d5959f2cfb4c tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.392735 Jun 02 10:23:50.281444 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 507/1008] 10.222.0.13 () {60 vars in 1161 bytes} [Thu Jun 2 10:23:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:50.288149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d6ae060e-2f60-4396-9445-4f63b2cdee37 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddfb6af0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:50.317526 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d6ae060e-2f60-4396-9445-4f63b2cdee37 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.033235 Jun 02 10:23:50.318122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 502/1009] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:50 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:50.327809 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2b990a69-14cf-43bc-8e7e-7ac3066985d9 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49dddc7280>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:50.357461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2b990a69-14cf-43bc-8e7e-7ac3066985d9 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033427 Jun 02 10:23:50.358022 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 508/1010] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 2 10:23:50 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:50.368285 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fa2881a7-2eb9-4133-a982-a3d358318b08 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddf6c3a0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:50.399649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fa2881a7-2eb9-4133-a982-a3d358318b08 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.033282 Jun 02 10:23:50.399649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 503/1011] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:50 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:51.410395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dc84b294-c0c6-4604-9a2d-0a7b904c8676 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49de7bf040>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:51.439560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dc84b294-c0c6-4604-9a2d-0a7b904c8676 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.034042 Jun 02 10:23:51.440115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 509/1012] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:51 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:52.451841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9908e262-92b7-4af6-837c-2d62673c2133 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddf261f0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:52.481579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9908e262-92b7-4af6-837c-2d62673c2133 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.034194 Jun 02 10:23:52.482122 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 504/1013] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:52 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:53.490643 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:53.491233 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:53.498695 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-28b17a62-3ca8-4959-990c-3ab816b04c50 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddcade50>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:53.526172 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-28b17a62-3ca8-4959-990c-3ab816b04c50 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.036800 Jun 02 10:23:53.526755 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 510/1014] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:53 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:54.534550 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=7 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:54.535333 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:54.539559 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cdaaf0a7-edc2-4b56-a205-10d11016e88a tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddfb6f70>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:54.568896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cdaaf0a7-edc2-4b56-a205-10d11016e88a tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.035456 Jun 02 10:23:54.569498 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 505/1015] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:54 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:55.580336 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9aab6055-e7a9-4d20-989f-8dca1b152eff tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddf30ee0>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:55.610926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9aab6055-e7a9-4d20-989f-8dca1b152eff tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 287 microversion: 2.1 time: 0.034818 Jun 02 10:23:55.611517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 511/1016] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:55 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:55.622247 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1481da97-4b91-4811-af4d-0274f307b727 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddfa4310>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:55.710371 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1481da97-4b91-4811-af4d-0274f307b727 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 202 len: 0 microversion: 2.1 time: 0.091971 Jun 02 10:23:55.711023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 506/1017] 10.222.0.13 () {58 vars in 1253 bytes} [Thu Jun 2 10:23:55 2022] DELETE /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:23:55.719112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-77874010-5db5-4b44-b9be-6c930c50f6ee tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49de8cff70>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:55.748705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-77874010-5db5-4b44-b9be-6c930c50f6ee tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 200 len: 286 microversion: 2.1 time: 0.033375 Jun 02 10:23:55.749270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 512/1018] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:55 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:56.761417 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c54170b8-fef6-4555-af0f-48783e2b44f0 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49de0d7550>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:56.786062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-c54170b8-fef6-4555-af0f-48783e2b44f0 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] HTTP exception thrown: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c54170b8-fef6-4555-af0f-48783e2b44f0 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Request method failure captured: Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d HTTP/1.1 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI-zS5eESpP_-lTJ7phZz5a5apnekzlx-NhgA0SFO2Jv3EXlkeDpFuJbHsph-IiGcv7p0Apt4yeA7OY1BpOXnjZYoqpfvY-zbiHQ6exra5-CNOffMoTuh1raziAmMchvJvPExmVu74aZgoFqEFdxSVBGcND5JlXrbzv3scCcFjGzFmI Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:56.789208 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 7879f5776d6a42a49bf099480d5f6c41 Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '6e010903-c34d-4270-9b35-efc2834e0b8d'} Jun 02 10:23:56.790886 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. (HTTP 404) (Request-ID: req-5fe1fd7a-9af1-41e3-83ec-4be743d3854d) Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.792102 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:56.793504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 02 10:23:56.795298 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c54170b8-fef6-4555-af0f-48783e2b44f0 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Returning 404 to user: Snapshot 6e010903-c34d-4270-9b35-efc2834e0b8d could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:56.796770 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c54170b8-fef6-4555-af0f-48783e2b44f0 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d" status: 404 len: 111 microversion: 2.1 time: 0.033547 Jun 02 10:23:56.797758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 507/1019] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 2 10:23:56 2022] GET /compute/v2.1/os-snapshots/6e010903-c34d-4270-9b35-efc2834e0b8d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:56.799634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-217605c5-ed09-4dbd-8fe4-6162a435cc15 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49de7bfc10>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:56.972247 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-217605c5-ed09-4dbd-8fe4-6162a435cc15 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 202 len: 0 microversion: 2.1 time: 0.176799 Jun 02 10:23:56.972931 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 513/1020] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:23:56 2022] DELETE /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 02 10:23:56.981891 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-21a313f2-298c-46bc-8ffe-4e8379f251e8 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddf6c790>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:57.028377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-21a313f2-298c-46bc-8ffe-4e8379f251e8 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 200 len: 345 microversion: 2.1 time: 0.050689 Jun 02 10:23:57.028945 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 508/1021] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:23:56 2022] GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:23:58.042381 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cbdc9a3b-fbc3-41d3-8efe-cb049bf32fd4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49ddf30940>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:58.068748 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-cbdc9a3b-fbc3-41d3-8efe-cb049bf32fd4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] HTTP exception thrown: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cbdc9a3b-fbc3-41d3-8efe-cb049bf32fd4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Request method failure captured: Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 HTTP/1.1 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI-zS5eESpP_-lTJ7phZz5a5apnekzlx-NhgA0SFO2Jv3EXlkeDpFuJbHsph-IiGcv7p0Apt4yeA7OY1BpOXnjZYoqpfvY-zbiHQ6exra5-CNOffMoTuh1raziAmMchvJvPExmVu74aZgoFqEFdxSVBGcND5JlXrbzv3scCcFjGzFmI Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:58.070713 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 7879f5776d6a42a49bf099480d5f6c41 Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '453e2dc6-3a77-4e18-9354-d566d914ae66'} Jun 02 10:23:58.072319 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. (HTTP 404) (Request-ID: req-b59a1f16-b9ea-4036-90cd-9cc9bf8c0e3c) Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.073406 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:58.074812 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 10:23:58.076189 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cbdc9a3b-fbc3-41d3-8efe-cb049bf32fd4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Returning 404 to user: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cbdc9a3b-fbc3-41d3-8efe-cb049bf32fd4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 404 len: 109 microversion: 2.1 time: 0.034126 Jun 02 10:23:58.077629 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 514/1022] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:23:58 2022] GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:58.087175 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1f5687f9-940e-4c25-bf45-5156b0c756a4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49de0d7e50>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:58.115607 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-1f5687f9-940e-4c25-bf45-5156b0c756a4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] HTTP exception thrown: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1f5687f9-940e-4c25-bf45-5156b0c756a4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Request method failure captured: Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 HTTP/1.1 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI-zS5eESpP_-lTJ7phZz5a5apnekzlx-NhgA0SFO2Jv3EXlkeDpFuJbHsph-IiGcv7p0Apt4yeA7OY1BpOXnjZYoqpfvY-zbiHQ6exra5-CNOffMoTuh1raziAmMchvJvPExmVu74aZgoFqEFdxSVBGcND5JlXrbzv3scCcFjGzFmI Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:23:58.117884 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 7879f5776d6a42a49bf099480d5f6c41 Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '453e2dc6-3a77-4e18-9354-d566d914ae66'} Jun 02 10:23:58.119490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. (HTTP 404) (Request-ID: req-a099726b-5111-4d42-86f0-87f6137829c3) Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.120485 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:23:58.121926 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 10:23:58.123344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-1f5687f9-940e-4c25-bf45-5156b0c756a4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Returning 404 to user: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-1f5687f9-940e-4c25-bf45-5156b0c756a4 tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 404 len: 109 microversion: 2.1 time: 0.037046 Jun 02 10:23:58.124726 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 509/1023] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:23:58 2022] DELETE /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:58.127730 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-25edcf87-403a-4ae3-8d24-c2bae98a6ffa tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Calling method '.version_select at 0x7f49dde7c670>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:23:58.154635 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-25edcf87-403a-4ae3-8d24-c2bae98a6ffa tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] HTTP exception thrown: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-25edcf87-403a-4ae3-8d24-c2bae98a6ffa tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Request method failure captured: Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 HTTP/1.1 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI-zS5eESpP_-lTJ7phZz5a5apnekzlx-NhgA0SFO2Jv3EXlkeDpFuJbHsph-IiGcv7p0Apt4yeA7OY1BpOXnjZYoqpfvY-zbiHQ6exra5-CNOffMoTuh1raziAmMchvJvPExmVu74aZgoFqEFdxSVBGcND5JlXrbzv3scCcFjGzFmI Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:23:58.156574 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/976ba9ecf8d44069a6a6a9a875bbc439"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 976ba9ecf8d44069a6a6a9a875bbc439 Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-819536246 Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 7879f5776d6a42a49bf099480d5f6c41 Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-819536246-project Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '453e2dc6-3a77-4e18-9354-d566d914ae66'} Jun 02 10:23:58.158115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. (HTTP 404) (Request-ID: req-19d0d30a-d22e-48c6-a5b9-d02c915b5349) Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.159183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:23:58.161257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 10:23:58.162775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-25edcf87-403a-4ae3-8d24-c2bae98a6ffa tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] Returning 404 to user: Volume 453e2dc6-3a77-4e18-9354-d566d914ae66 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-25edcf87-403a-4ae3-8d24-c2bae98a6ffa tempest-VolumesSnapshotsTestJSON-819536246 tempest-VolumesSnapshotsTestJSON-819536246-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66" status: 404 len: 109 microversion: 2.1 time: 0.034040 Jun 02 10:23:58.164220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 515/1024] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:23:58 2022] GET /compute/v2.1/os-volumes/453e2dc6-3a77-4e18-9354-d566d914ae66 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:24:40.488737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:40.489271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:40.495235 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:40.495691 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:40.496466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:40.496910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:40.577322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lazy-loading 'services' on Instance uuid 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:24:40.777944 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0c274257-3572-4a56-a648-b6b53f443b03 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments/f5be5ef4-e3e5-4b85-bd86-59f5438fcb04" status: 202 len: 0 microversion: 2.1 time: 0.293947 Jun 02 10:24:40.778796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 510/1025] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:24:40 2022] DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments/f5be5ef4-e3e5-4b85-bd86-59f5438fcb04 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:24:42.946645 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5991d0f3-c5d3-407e-95ed-be93e5c70343 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:24:42.953790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5991d0f3-c5d3-407e-95ed-be93e5c70343 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:42.954239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5991d0f3-c5d3-407e-95ed-be93e5c70343 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:42.975536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5991d0f3-c5d3-407e-95ed-be93e5c70343 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Going to try to stop instance {{(pid=118066) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 02 10:24:43.157133 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5991d0f3-c5d3-407e-95ed-be93e5c70343 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action" status: 202 len: 0 microversion: 2.1 time: 0.215194 Jun 02 10:24:43.157675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 516/1026] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:24:42 2022] POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:24:43.166922 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:43.167663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:43.173801 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:43.174260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:43.175036 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:43.176032 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:43.312050 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:43.320129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b784192a-8479-4009-8ffd-548bf3c2d71e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.157951 Jun 02 10:24:43.320938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 511/1027] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:43 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:24:44.275543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:44.277374 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:44.285476 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.285960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.286780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.287369 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.318978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d7638950-e9f5-4e51-acea-6fa2ffb6f883 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048626 Jun 02 10:24:44.319702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 517/1028] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 2 10:24:44 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:44.338620 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:44.340118 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:44.346773 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.347312 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.348092 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.348531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.378862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:44.381838 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:44.385418 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.385870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.386674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.387139 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.412025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:24:44.479947 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:44.487464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-74c9d8b5-68cf-4b57-9b75-d148a8f759f0 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.153184 Jun 02 10:24:44.488577 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 512/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:44 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:44.668739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-bd5b4f93-e8c9-448b-b939-d180becccf99 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 204 len: 0 microversion: 2.20 time: 0.294112 Jun 02 10:24:44.669326 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 518/1030] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 2 10:24:44 2022] DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 02 10:24:44.677834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:44.678449 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:44.685665 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.685910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.686681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:44.687155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:44.818394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:44.826503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:44.828198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:44.829433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-92548f2a-13f9-44b7-a79e-0397bcf53d0d tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.155720 Jun 02 10:24:44.830038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 513/1031] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:44 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:24:45.505943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:45.506551 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:45.512926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:45.513375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:45.514127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:45.514558 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:45.640654 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:45.648103 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-48f9faec-7a2a-4ae0-bf24-6742235f84a4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.146482 Jun 02 10:24:45.648660 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 519/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:45 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:45.849597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:45.850219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:45.857016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:45.857472 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:45.858242 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:45.858689 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:45.995217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:46.003927 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:46.005452 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:46.006743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-dac28131-36c5-491e-81b8-944f54c305e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.160915 Jun 02 10:24:46.007178 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 514/1033] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:45 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:24:46.663959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:46.664575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:46.671153 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:46.671608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:46.672373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:46.672817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:46.805137 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:46.812949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-42a21a1d-b585-4935-b99e-b6ced3eb4857 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.152856 Jun 02 10:24:46.813531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 520/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:46 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:47.025051 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:47.025667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:47.032621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:47.033086 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:47.033873 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:47.034796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:47.270158 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:47.278481 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:47.280108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:47.281514 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-23b4d027-5590-4518-ac2c-a9fd6dba03e7 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1723 microversion: 2.20 time: 0.260371 Jun 02 10:24:47.281935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 515/1035] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:47 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:24:47.837377 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-fb580288-eeb1-4c63-ba8b-0da8dd7cd5c6 req-f5736e88-2af1-42cd-8628-f0ae9dfa043f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b938d7-e7b3-49c8-9347-00e886063ae0", "name": "network-vif-deleted", "tag": "01998461-a63b-4df3-ac5c-c204a7294439"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:24:47.839188 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:47.840601 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:47.855522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fb580288-eeb1-4c63-ba8b-0da8dd7cd5c6 req-f5736e88-2af1-42cd-8628-f0ae9dfa043f service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:47.855967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-fb580288-eeb1-4c63-ba8b-0da8dd7cd5c6 req-f5736e88-2af1-42cd-8628-f0ae9dfa043f service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:47.857374 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:47.857895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:47.858683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:47.859162 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:47.877253 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-fb580288-eeb1-4c63-ba8b-0da8dd7cd5c6 req-f5736e88-2af1-42cd-8628-f0ae9dfa043f service nova] Creating event network-vif-deleted:01998461-a63b-4df3-ac5c-c204a7294439 for instance 16b938d7-e7b3-49c8-9347-00e886063ae0 on hv-cinder-79760 Jun 02 10:24:47.885659 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-fb580288-eeb1-4c63-ba8b-0da8dd7cd5c6 req-f5736e88-2af1-42cd-8628-f0ae9dfa043f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191185 Jun 02 10:24:47.886261 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 521/1036] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:24:48.037269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:48.044806 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b50227d8-d838-4722-8d0a-1f56c42458ee tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.217943 Jun 02 10:24:48.045315 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 516/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:47 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:24:48.300188 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:48.300888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:48.306956 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:48.307440 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:48.308204 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:48.308642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:48.339636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:48.340080 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:48.340524 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lazy-loading 'fault' on Instance uuid 16b938d7-e7b3-49c8-9347-00e886063ae0 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:24:48.381772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:48.389573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:48.391059 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a6e44ab0c394541a7d7b290928ea6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a083c564db474e80af22b7c21af82775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:48.392254 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8ab96fd8-1aab-4396-8ae4-10efddd66f13 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 200 len: 1370 microversion: 2.20 time: 0.096497 Jun 02 10:24:48.392802 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 522/1038] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:48 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 02 10:24:49.062609 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:49.063552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:49.070413 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:49.070966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:49.071793 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:49.072241 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:49.204877 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:49.213073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-266906c4-8826-41c9-b16b-e3e4300f1313 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.154544 Jun 02 10:24:49.213644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 517/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:49 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:49.410908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:49.411488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:49.417825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:49.418275 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:49.419028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:49.419492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:49.432456 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 HTTP/1.1 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:24:49.434067 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:49.435798 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '16b938d7-e7b3-49c8-9347-00e886063ae0'} Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:24:49.436828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:49.438503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:49.440183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:24:49.440183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d4b66412-925b-42af-828b-c1e3a482d50b tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 404 len: 111 microversion: 2.20 time: 0.028604 Jun 02 10:24:49.440183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 523/1040] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:49 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:24:49.444675 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-ee54f3ec-84c9-42a8-bcc4-5a5863f6d364 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '.version_select at 0x7f49ddda5f70>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:49.526393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-ee54f3ec-84c9-42a8-bcc4-5a5863f6d364 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76809209" status: 204 len: 0 microversion: 2.20 time: 0.085999 Jun 02 10:24:49.527113 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 518/1041] 10.222.0.13 () {60 vars in 1255 bytes} [Thu Jun 2 10:24:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76809209 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 02 10:24:50.230028 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:50.230648 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:50.236770 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:50.237221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:50.238046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:50.238490 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:50.383273 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:50.391118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7a6a93fa-582b-4ec0-a329-2627702a69dd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.165337 Jun 02 10:24:50.391663 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 524/1042] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:50 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:51.408697 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:51.409320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:51.415342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.415798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.416567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.417011 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.544179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:51.552203 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-32956a5a-5414-4dce-9c65-f7ffdb34e99c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.148015 Jun 02 10:24:51.552766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 519/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:51 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:51.582517 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:51.583007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:51.590539 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.590998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.591949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.592320 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.609358 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 HTTP/1.1 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:24:51.610944 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.612621 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '16b938d7-e7b3-49c8-9347-00e886063ae0'} Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:24:51.614446 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.616102 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.617977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:24:51.617977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5e1f277f-cc71-425b-adf0-4cca62160845 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 404 len: 111 microversion: 2.20 time: 0.033977 Jun 02 10:24:51.617977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 525/1044] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 2 10:24:51 2022] DELETE /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:24:51.621478 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:51.622091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: 16b938d7-e7b3-49c8-9347-00e886063ae0] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:51.628177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.628631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.629434 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:51.629876 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:51.642814 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 HTTP/1.1 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:24:51.644462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.646120 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '16b938d7-e7b3-49c8-9347-00e886063ae0'} Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:24:51.647194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. Jun 02 10:24:51.648673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:51.650209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance 16b938d7-e7b3-49c8-9347-00e886063ae0 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:24:51.650209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-51291827-8c77-4aef-ae48-f30d08ab4ba3 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0" status: 404 len: 111 microversion: 2.20 time: 0.028201 Jun 02 10:24:51.650209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 520/1045] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:51 2022] GET /compute/v2.1/servers/16b938d7-e7b3-49c8-9347-00e886063ae0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:24:52.569496 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:52.570405 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:52.576784 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:52.577223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:52.580046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:52.580046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:52.705389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:52.712965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-058de269-ae30-43cf-a5be-1c31d6cbff21 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.148448 Jun 02 10:24:52.713528 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 526/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:52 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:52.965398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:52.965898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:52.972367 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:52.973473 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:52.974204 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:52.974642 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:52.987910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 HTTP/1.1 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:24:52.990108 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:52.991838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'a1c797f6-e7bc-4bbb-8553-cb14810886e3'} Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:24:52.992777 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:52.994297 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:24:52.996217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:24:52.996217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a410b4db-bda4-48bb-a4f0-d0f7b0a8a0f8 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 404 len: 111 microversion: 2.20 time: 0.029976 Jun 02 10:24:52.996217 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 521/1047] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 2 10:24:52 2022] DELETE /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:24:52.999691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:53.000304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] [instance: a1c797f6-e7bc-4bbb-8553-cb14810886e3] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:53.006265 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:53.006715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:53.007500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:53.007941 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:53.021076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] HTTP exception thrown: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Request method failure captured: Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 HTTP/1.1 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI2J9Z19k72mNVayiBdyKkviL1Z8a3Cg6-VyYMzK8bymoiGg3xAQxS1M4vwe1tt5Rx4cEU0-w_fhqmqNrUrtxc2aBzGbXp8l6chrW8y9gT_vu7mMJSfbOvJNbNyeRPrAOYF9ZJKxsJCeFG5YWxIQ15w1Q5JdsA5s9bJxm8RCol9C5-k Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Openstack-Nova-Api-Version: 2.20 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:24:53.022566 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a083c564db474e80af22b7c21af82775"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a083c564db474e80af22b7c21af82775"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a083c564db474e80af22b7c21af82775"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: a083c564db474e80af22b7c21af82775 Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2094563870 Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 5a6e44ab0c394541a7d7b290928ea6f8 Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2094563870-project Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:53.024568 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'a1c797f6-e7bc-4bbb-8553-cb14810886e3'} Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:24:53.025351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. Jun 02 10:24:53.026613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:24:53.027777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] Returning 404 to user: Instance a1c797f6-e7bc-4bbb-8553-cb14810886e3 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:24:53.027777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-58bb49c6-cf4c-4794-9518-5433f0702825 tempest-AttachVolumeShelveTestJSON-2094563870 tempest-AttachVolumeShelveTestJSON-2094563870-project] 10.222.0.13 "GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3" status: 404 len: 111 microversion: 2.20 time: 0.028028 Jun 02 10:24:53.027777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 527/1048] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 2 10:24:52 2022] GET /compute/v2.1/servers/a1c797f6-e7bc-4bbb-8553-cb14810886e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 02 10:24:53.730155 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:53.730695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:53.736717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:53.737179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:53.737955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:53.738402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:53.943563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:53.951307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4f1da3ab-6be0-4bc1-8dca-016d0698176d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.225367 Jun 02 10:24:53.952030 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 522/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:53 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:54.968625 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:54.969255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:54.975813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:54.976278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:54.977057 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:54.977675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:55.120789 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:55.128308 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-af8bec7f-7585-41f9-8912-e11b934064b1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.163870 Jun 02 10:24:55.128871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 528/1050] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:54 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:56.146848 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:56.147508 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:56.154304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:56.154757 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:56.155595 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:56.156003 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:56.301825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:56.309715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4c14e12e-2e22-4a39-aa0d-e183e2b9dc72 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.167677 Jun 02 10:24:56.319353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 523/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:56 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:57.327940 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:57.328543 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:57.337729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:57.337729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:57.337729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:57.338122 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:57.477392 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:57.485262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0d6944b9-149e-4372-8e11-a9883e733f1a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.161327 Jun 02 10:24:57.485819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 529/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:57 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:58.501669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:58.502500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:58.510643 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:58.511338 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:58.512126 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:58.512571 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:58.645602 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:58.653880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-537f5e76-005b-4bfe-b9af-020adc66336a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1679 microversion: 2.1 time: 0.156145 Jun 02 10:24:58.658610 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 524/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:58 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:59.670953 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:24:59.671687 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:24:59.678686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:59.679163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:59.679943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:59.680386 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:59.813800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:24:59.822314 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0cb47a6a-5b3d-4b59-bcc1-aa0bb6d63916 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1656 microversion: 2.1 time: 0.155326 Jun 02 10:24:59.822977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 530/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:24:59 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:24:59.847989 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-be183185-a554-4360-80fc-2f92faeecf8d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:24:59.854915 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be183185-a554-4360-80fc-2f92faeecf8d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:24:59.855586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-be183185-a554-4360-80fc-2f92faeecf8d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:24:59.878432 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-be183185-a554-4360-80fc-2f92faeecf8d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Going to try to start instance {{(pid=118067) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 02 10:25:00.082549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-be183185-a554-4360-80fc-2f92faeecf8d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action" status: 202 len: 0 microversion: 2.1 time: 0.238138 Jun 02 10:25:00.083068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 525/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 2 10:24:59 2022] POST /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:25:00.091245 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:00.091878 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:00.097895 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:00.098349 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:00.099159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:00.099592 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:00.231292 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:00.239351 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-69f724e9-9948-4767-a854-422cf7558c60 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1665 microversion: 2.1 time: 0.152055 Jun 02 10:25:00.240251 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 531/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:00 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:01.259004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:01.259740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:01.273088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:01.273088 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:01.274053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:01.274233 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:01.412943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:01.420724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5a203544-b59c-488d-9ba9-c634cddc61d9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1665 microversion: 2.1 time: 0.168167 Jun 02 10:25:01.421291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 526/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:01 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:02.438049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:02.438637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:02.445715 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:02.446106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:02.446862 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:02.447328 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:02.451399 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:02.580379 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:02.588043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0c69d05-4b80-49f1-9b65-c288375ed465 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1669 microversion: 2.1 time: 0.153796 Jun 02 10:25:02.588611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 532/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:02 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:48.910825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:48.911403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:48.913438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-359d3ee9-8821-4e94-b765-98f874ce0b0c req-89f41f43-225d-4c28-a9aa-cf9d40f55c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922fc677-740c-48fa-8361-883992d8b050", "tag": "2eba471d-644b-4156-9829-2bffb764f522"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:48.913870 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:48.914453 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:48.917641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:48.921160 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=4 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:25:48.921290 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:48.921639 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:48.922515 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:48.923024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:48.923952 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-359d3ee9-8821-4e94-b765-98f874ce0b0c req-89f41f43-225d-4c28-a9aa-cf9d40f55c5c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:48.924601 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-359d3ee9-8821-4e94-b765-98f874ce0b0c req-89f41f43-225d-4c28-a9aa-cf9d40f55c5c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:48.935723 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-359d3ee9-8821-4e94-b765-98f874ce0b0c req-89f41f43-225d-4c28-a9aa-cf9d40f55c5c service nova] Creating event network-changed:2eba471d-644b-4156-9829-2bffb764f522 for instance 922fc677-740c-48fa-8361-883992d8b050 on hv-cinder-79760 Jun 02 10:25:48.941613 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-359d3ee9-8821-4e94-b765-98f874ce0b0c req-89f41f43-225d-4c28-a9aa-cf9d40f55c5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Jun 02 10:25:48.942541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 533/1059] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:25:48.956342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:25:49.368672 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8fd47382-0861-4da7-ba38-caecca688607 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 204 len: 0 microversion: 2.1 time: 0.457906 Jun 02 10:25:49.368672 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 527/1060] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:25:48 2022] DELETE /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:25:49.376871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:49.378487 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:49.386902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:49.388301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:49.389673 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:49.390365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:49.533185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:49.540837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-403f7ab2-997d-4875-bef8-dd72ae9f0910 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1579 microversion: 2.1 time: 0.169521 Jun 02 10:25:49.541646 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 534/1061] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:49 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:50.565179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:50.565898 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:50.573225 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:50.574737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:50.574737 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:50.574965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:50.711971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:50.720161 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cb8c9384-a7d0-45c7-9d4e-11259cd10619 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1460 microversion: 2.1 time: 0.160046 Jun 02 10:25:50.720722 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 528/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:50 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1460 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:51.567704 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-07d284e6-976d-4f46-88ff-5c23d2f64bda req-e007b706-9780-4c96-94b3-4720dd4acdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922fc677-740c-48fa-8361-883992d8b050", "name": "network-vif-deleted", "tag": "2eba471d-644b-4156-9829-2bffb764f522"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:51.576992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-07d284e6-976d-4f46-88ff-5c23d2f64bda req-e007b706-9780-4c96-94b3-4720dd4acdc0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:51.577443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-07d284e6-976d-4f46-88ff-5c23d2f64bda req-e007b706-9780-4c96-94b3-4720dd4acdc0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:51.588910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-07d284e6-976d-4f46-88ff-5c23d2f64bda req-e007b706-9780-4c96-94b3-4720dd4acdc0 service nova] Creating event network-vif-deleted:2eba471d-644b-4156-9829-2bffb764f522 for instance 922fc677-740c-48fa-8361-883992d8b050 on hv-cinder-79760 Jun 02 10:25:51.594401 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-07d284e6-976d-4f46-88ff-5c23d2f64bda req-e007b706-9780-4c96-94b3-4720dd4acdc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Jun 02 10:25:51.598193 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 535/1063] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:25:51.737863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:51.738667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:51.745616 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:51.746147 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:51.747265 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:51.747783 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:51.812403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:51.819962 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2d7da50d-b42d-440c-855c-92fedfb81ca0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 200 len: 1226 microversion: 2.1 time: 0.086039 Jun 02 10:25:51.820535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 529/1064] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:51 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:52.837857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:52.838549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 922fc677-740c-48fa-8361-883992d8b050] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:52.844762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:52.845208 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:52.845961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:52.846396 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:52.860232 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] HTTP exception thrown: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Request method failure captured: Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 HTTP/1.1 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI3z3e0AK00UUyuXC1EH5VLdaBMpC7XU91XonTHi9s0DbJnLTWXX8rYNfHXDqquIixOdKA44eGH0gwPA9v-xyt1PvJkiN8bS4SXFzumnxrNo_00QKJvjHULLW-hNCdzJuVJaVLweOhWHq0RVYzh6RHcQMN8G35FvO3uMZK8eJQcZuLo Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:25:52.861893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 722fc8b42ea941499a56937ce0d8ad3a Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. Jun 02 10:25:52.869132 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '922fc677-740c-48fa-8361-883992d8b050'} Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:25:52.870519 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. Jun 02 10:25:52.872746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:25:52.874168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Returning 404 to user: Instance 922fc677-740c-48fa-8361-883992d8b050 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:25:52.874168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7502fc04-4d7d-4f62-9edd-431e960875c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050" status: 404 len: 111 microversion: 2.1 time: 0.030181 Jun 02 10:25:52.874168 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 536/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:52 2022] GET /compute/v2.1/servers/922fc677-740c-48fa-8361-883992d8b050 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:25:53.551029 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1107218157", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "networks": [{"uuid": "4721d5f3-b6c1-4b66-8cdd-bb00151effa8"}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:53.604353 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] validate_networks() for [('4721d5f3-b6c1-4b66-8cdd-bb00151effa8', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:25:54.019082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:25:54.019549 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:25:54.020029 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:25:54.020443 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:25:54.020859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:25:54.029764 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:54.030220 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:54.031023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:54.031496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:54.047797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Getting quotas for project e5b8100379874f6da5d5c872d2d3e103. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:25:54.051759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Getting quotas for user 70b0e2d2652f462da1e5d5899ce0dee0 and project e5b8100379874f6da5d5c872d2d3e103. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:25:54.063007 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:25:54.065237 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:25:54.178563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9d39203e-aa0a-45f5-bcfb-19a9de76c228 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631389 Jun 02 10:25:54.179433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 530/1066] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:25:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:25:54.189502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3e1c7264-7b50-45d2-83c3-73790d9940d7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:54.190115 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3e1c7264-7b50-45d2-83c3-73790d9940d7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:54.245049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3e1c7264-7b50-45d2-83c3-73790d9940d7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:54.252457 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3e1c7264-7b50-45d2-83c3-73790d9940d7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1214 microversion: 2.1 time: 0.066755 Jun 02 10:25:54.253019 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 537/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:54 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:55.270077 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:55.270470 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:55.277624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:55.278079 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:55.279517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:55.279973 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:55.343404 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:55.350889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0675fe4a-30e0-43e3-bcb2-1fff074f7447 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1218 microversion: 2.1 time: 0.085659 Jun 02 10:25:55.351494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 531/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:55 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:56.209030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:56.210159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:56.220362 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.221434 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.222530 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.222981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.250926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:25:56.378775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-8317c7fd-5017-4079-812d-09ebb36fb513 req-e3917b07-1f1c-435a-924c-24eea4cd1808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7c48663-ab05-403a-b720-7de5695365ec", "tag": "ad59041b-c2bd-453d-a9a4-754ba8f1c306"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:56.391238 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8317c7fd-5017-4079-812d-09ebb36fb513 req-e3917b07-1f1c-435a-924c-24eea4cd1808 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.396494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-8317c7fd-5017-4079-812d-09ebb36fb513 req-e3917b07-1f1c-435a-924c-24eea4cd1808 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.409532 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-8317c7fd-5017-4079-812d-09ebb36fb513 req-e3917b07-1f1c-435a-924c-24eea4cd1808 service nova] Creating event network-changed:ad59041b-c2bd-453d-a9a4-754ba8f1c306 for instance f7c48663-ab05-403a-b720-7de5695365ec on hv-cinder-79760 Jun 02 10:25:56.414666 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-8317c7fd-5017-4079-812d-09ebb36fb513 req-e3917b07-1f1c-435a-924c-24eea4cd1808 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207417 Jun 02 10:25:56.415393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 532/1069] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:25:56.421307 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:56.422083 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:56.438935 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.439721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.440733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.441370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.529752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:56.538592 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5c51e362-1d3b-4f42-9f51-9b37472e1ebf tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1274 microversion: 2.1 time: 0.121954 Jun 02 10:25:56.539572 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 533/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:56 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:56.560257 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a682e5aa-96e0-4dcd-8858-0a045e2dc373 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 204 len: 0 microversion: 2.1 time: 0.354529 Jun 02 10:25:56.562552 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 538/1071] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:25:56 2022] DELETE /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:25:56.572469 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:56.573429 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:56.583184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.584221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.585224 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:56.586376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:56.743623 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:56.751810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3f9dd46e-9860-47bf-a125-6f273ea37bae tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1578 microversion: 2.1 time: 0.183164 Jun 02 10:25:56.753049 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 534/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:56 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:25:57.556617 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:57.557472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:57.563910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:57.564485 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:57.565505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:57.566164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:57.760393 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:57.767445 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-664de774-88a4-47bd-9c92-601a19a75d84 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.215382 Jun 02 10:25:57.775421 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 539/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:57 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:57.775646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:57.775646 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:57.777875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:57.778336 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:57.779635 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:57.780078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:57.926794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:57.934343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4a06ee2c-aafc-4fa9-b71a-014a84aac132 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1459 microversion: 2.1 time: 0.168368 Jun 02 10:25:57.934928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 535/1074] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:57 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:25:58.301411 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-4a84f813-112b-4cd9-9caf-0daf16bdb33d req-6e25b5f4-4b6d-49ce-9280-a7a22df5561e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c40f1c-92aa-46c1-9e87-8a28c73b52f8", "tag": "54f1b7a8-af8d-48af-9a31-d312a7085ad1"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:58.311886 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-4a84f813-112b-4cd9-9caf-0daf16bdb33d req-6e25b5f4-4b6d-49ce-9280-a7a22df5561e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.312622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-4a84f813-112b-4cd9-9caf-0daf16bdb33d req-6e25b5f4-4b6d-49ce-9280-a7a22df5561e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.324506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-4a84f813-112b-4cd9-9caf-0daf16bdb33d req-6e25b5f4-4b6d-49ce-9280-a7a22df5561e service nova] Creating event network-changed:54f1b7a8-af8d-48af-9a31-d312a7085ad1 for instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 on hv-cinder-79760 Jun 02 10:25:58.336678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-4a84f813-112b-4cd9-9caf-0daf16bdb33d req-6e25b5f4-4b6d-49ce-9280-a7a22df5561e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034818 Jun 02 10:25:58.336678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 540/1075] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:25:58.429513 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-223b37ce-4fb8-428d-9895-37d0c74c0670 req-41f04b78-7232-4aea-80f7-c81693318154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7c48663-ab05-403a-b720-7de5695365ec", "name": "network-vif-deleted", "tag": "ad59041b-c2bd-453d-a9a4-754ba8f1c306"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:25:58.438816 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-223b37ce-4fb8-428d-9895-37d0c74c0670 req-41f04b78-7232-4aea-80f7-c81693318154 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.439245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-223b37ce-4fb8-428d-9895-37d0c74c0670 req-41f04b78-7232-4aea-80f7-c81693318154 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.455569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-223b37ce-4fb8-428d-9895-37d0c74c0670 req-41f04b78-7232-4aea-80f7-c81693318154 service nova] Creating event network-vif-deleted:ad59041b-c2bd-453d-a9a4-754ba8f1c306 for instance f7c48663-ab05-403a-b720-7de5695365ec on hv-cinder-79760 Jun 02 10:25:58.456160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-223b37ce-4fb8-428d-9895-37d0c74c0670 req-41f04b78-7232-4aea-80f7-c81693318154 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Jun 02 10:25:58.456750 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 536/1076] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:25:58.785138 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:58.785849 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:58.792323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.792775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.793549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.793992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.931541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:58.939756 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e2062563-c508-4ab5-9a3b-25e607611bf7 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.159193 Jun 02 10:25:58.940512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 541/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:58 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:25:58.952556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:58.953365 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:58.960010 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.960540 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.961303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.961736 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.994041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:58.994490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:58.994943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lazy-loading 'fault' on Instance uuid f7c48663-ab05-403a-b720-7de5695365ec {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:25:59.077280 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '722fc8b42ea941499a56937ce0d8ad3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21c0abf697ed4e29870a594ed83de6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:25:59.085039 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c1aef959-dc98-4d8b-b3a4-edde08ec620b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 200 len: 1231 microversion: 2.1 time: 0.137506 Jun 02 10:25:59.085631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 537/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:58 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 1231 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:25:59.956661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:25:59.957312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:25:59.963915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:59.964371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:25:59.965135 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:25:59.965579 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.091860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:00.099378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-5309476a-3a28-4d78-a2ec-02dc29099f7c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.146582 Jun 02 10:26:00.099935 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 542/1079] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:25:59 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:00.103864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:00.105099 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: f7c48663-ab05-403a-b720-7de5695365ec] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:00.114179 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.114652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.115463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.121825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.129175 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] HTTP exception thrown: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Request method failure captured: Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec HTTP/1.1 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI3z3e0AK00UUyuXC1EH5VLdaBMpC7XU91XonTHi9s0DbJnLTWXX8rYNfHXDqquIixOdKA44eGH0gwPA9v-xyt1PvJkiN8bS4SXFzumnxrNo_00QKJvjHULLW-hNCdzJuVJaVLweOhWHq0RVYzh6RHcQMN8G35FvO3uMZK8eJQcZuLo Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:26:00.130786 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 722fc8b42ea941499a56937ce0d8ad3a Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. Jun 02 10:26:00.132536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'f7c48663-ab05-403a-b720-7de5695365ec'} Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:00.133534 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. Jun 02 10:26:00.135044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.136619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Returning 404 to user: Instance f7c48663-ab05-403a-b720-7de5695365ec could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:00.136619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c7821c97-706c-4a9d-96b4-1f6fb14a4a8b tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec" status: 404 len: 111 microversion: 2.1 time: 0.034019 Jun 02 10:26:00.136619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 538/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:00 2022] GET /compute/v2.1/servers/f7c48663-ab05-403a-b720-7de5695365ec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:00.657438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:00.657967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:00.663967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.664420 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.665181 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.665619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.678500 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] HTTP exception thrown: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Request method failure captured: Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 HTTP/1.1 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI3z3e0AK00UUyuXC1EH5VLdaBMpC7XU91XonTHi9s0DbJnLTWXX8rYNfHXDqquIixOdKA44eGH0gwPA9v-xyt1PvJkiN8bS4SXFzumnxrNo_00QKJvjHULLW-hNCdzJuVJaVLweOhWHq0RVYzh6RHcQMN8G35FvO3uMZK8eJQcZuLo Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:26:00.680163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 722fc8b42ea941499a56937ce0d8ad3a Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.681734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '344510b0-0870-4e81-bd36-06531d08f864'} Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:00.682573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.684064 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.686048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Returning 404 to user: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:00.686048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f9b3b387-5b96-4f8a-a55f-b9eaacf5579e tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "DELETE /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 404 len: 111 microversion: 2.1 time: 0.028035 Jun 02 10:26:00.686048 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 543/1081] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:26:00 2022] DELETE /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:00.690372 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:00.690988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] [instance: 344510b0-0870-4e81-bd36-06531d08f864] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:00.697004 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.697460 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.698221 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:00.698661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:00.712759 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] HTTP exception thrown: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Request method failure captured: Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 HTTP/1.1 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI3z3e0AK00UUyuXC1EH5VLdaBMpC7XU91XonTHi9s0DbJnLTWXX8rYNfHXDqquIixOdKA44eGH0gwPA9v-xyt1PvJkiN8bS4SXFzumnxrNo_00QKJvjHULLW-hNCdzJuVJaVLweOhWHq0RVYzh6RHcQMN8G35FvO3uMZK8eJQcZuLo Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:26:00.714296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/21c0abf697ed4e29870a594ed83de6c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 21c0abf697ed4e29870a594ed83de6c7 Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-TestVolumeBootPattern-1875060126 Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 722fc8b42ea941499a56937ce0d8ad3a Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-TestVolumeBootPattern-1875060126-project Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.715899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '344510b0-0870-4e81-bd36-06531d08f864'} Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:00.716775 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. Jun 02 10:26:00.718236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:00.719594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Returning 404 to user: Instance 344510b0-0870-4e81-bd36-06531d08f864 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:00.719594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-edfc4cfc-d09f-4ab0-9d3d-3c19f4dc9f6c tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864" status: 404 len: 111 microversion: 2.1 time: 0.029112 Jun 02 10:26:00.719594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 539/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:00 2022] GET /compute/v2.1/servers/344510b0-0870-4e81-bd36-06531d08f864 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:01.116939 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:01.117509 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:01.124046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:01.124522 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:01.125312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:01.125752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:01.257058 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:01.265282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d650369f-30cc-43c6-a9a3-b9b045ecd2dd tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.152438 Jun 02 10:26:01.265859 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 544/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:01 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:02.285250 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:02.289888 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-603d5b37-2482-4125-9452-7df7d41122c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] Calling method '.version_select at 0x7f49ddd8cb80>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:02.292725 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:02.301218 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:02.305492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:02.305492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:02.305492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:02.371740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-603d5b37-2482-4125-9452-7df7d41122c0 tempest-TestVolumeBootPattern-1875060126 tempest-TestVolumeBootPattern-1875060126-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1204552918" status: 202 len: 0 microversion: 2.1 time: 0.091118 Jun 02 10:26:02.372529 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 545/1084] 10.222.0.13 () {58 vars in 1262 bytes} [Thu Jun 2 10:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1204552918 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:26:02.445640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:02.455669 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9970c8ce-a8e9-4bb6-a380-dddfcad5c68e tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.177164 Jun 02 10:26:02.456683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 540/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:02 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:03.474670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:03.475641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:03.485709 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:03.486270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:03.487260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:03.487735 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:03.738549 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:03.745823 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-97664330-9006-4b74-801a-ba9780974161 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.277063 Jun 02 10:26:03.746389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 546/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:03 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:04.635345 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:04.639320 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:04.693338 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-6c15e06a-739d-4717-ac7e-f16817abe533 req-369b22f8-4df6-4169-a8f1-10c7dc14bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c40f1c-92aa-46c1-9e87-8a28c73b52f8", "name": "network-vif-plugged", "status": "completed", "tag": "54f1b7a8-af8d-48af-9a31-d312a7085ad1"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:04.702742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-6c15e06a-739d-4717-ac7e-f16817abe533 req-369b22f8-4df6-4169-a8f1-10c7dc14bbfd service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:04.708203 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-6c15e06a-739d-4717-ac7e-f16817abe533 req-369b22f8-4df6-4169-a8f1-10c7dc14bbfd service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:04.714199 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-6c15e06a-739d-4717-ac7e-f16817abe533 req-369b22f8-4df6-4169-a8f1-10c7dc14bbfd service nova] Creating event network-vif-plugged:54f1b7a8-af8d-48af-9a31-d312a7085ad1 for instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 on hv-cinder-79760 Jun 02 10:26:04.719018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-6c15e06a-739d-4717-ac7e-f16817abe533 req-369b22f8-4df6-4169-a8f1-10c7dc14bbfd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088662 Jun 02 10:26:04.719882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 541/1087] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:04.763514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:04.764311 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:04.767438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:04.778025 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:04.778817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:04.779856 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:04.780455 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:04.932161 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:04.940309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c1828aab-62f6-45d4-b35c-c45a165e1540 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.181032 Jun 02 10:26:04.940961 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 547/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:04 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:05.960318 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:05.961111 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:05.976257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:05.976257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:05.976257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:05.976257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:06.210480 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:06.220287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7d90f78a-ee54-4b02-8a6a-ce38169cd8f6 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1314 microversion: 2.1 time: 0.263986 Jun 02 10:26:06.220287 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 542/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:05 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:07.235206 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:07.235836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:07.242660 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:07.243146 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:07.243926 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:07.244368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:07.417479 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:07.424905 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-34feeba4-15a9-43a0-aec7-76503b8ba559 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1497 microversion: 2.1 time: 0.193983 Jun 02 10:26:07.425460 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 548/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:07 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:08.186450 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:08.187677 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:08.194471 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:08.194943 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:08.195769 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:08.196214 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:08.221487 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Going to try to terminate instance {{(pid=118067) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:26:08.363710 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:08.553579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3d9301fe-24de-40a7-92e3-e44ac86483c0 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 204 len: 0 microversion: 2.1 time: 0.370723 Jun 02 10:26:08.554183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 543/1091] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:26:08 2022] DELETE /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:26:08.563081 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:08.565295 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:08.570567 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:08.571018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:08.571873 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:08.572276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:08.781309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:08.789034 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d35e5b8e-c64b-4eb6-bfc4-a6474bc5635c tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1503 microversion: 2.1 time: 0.230364 Jun 02 10:26:08.789599 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 549/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:08 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:09.806506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:09.811504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:09.814995 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:09.815475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:09.816260 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:09.816699 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:10.030059 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:10.037562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-90144b39-5536-40c8-91ba-1a75388c7b62 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1503 microversion: 2.1 time: 0.235412 Jun 02 10:26:10.038129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 544/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:09 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:10.654622 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-d23fcf84-a6ba-4293-aee9-637ad34856aa req-72cd969d-396d-48ae-873d-3a87a51c811c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c40f1c-92aa-46c1-9e87-8a28c73b52f8", "name": "network-vif-deleted", "tag": "54f1b7a8-af8d-48af-9a31-d312a7085ad1"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:10.664436 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d23fcf84-a6ba-4293-aee9-637ad34856aa req-72cd969d-396d-48ae-873d-3a87a51c811c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:10.664889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-d23fcf84-a6ba-4293-aee9-637ad34856aa req-72cd969d-396d-48ae-873d-3a87a51c811c service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:10.676913 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-d23fcf84-a6ba-4293-aee9-637ad34856aa req-72cd969d-396d-48ae-873d-3a87a51c811c service nova] Creating event network-vif-deleted:54f1b7a8-af8d-48af-9a31-d312a7085ad1 for instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 on hv-cinder-79760 Jun 02 10:26:10.682075 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-d23fcf84-a6ba-4293-aee9-637ad34856aa req-72cd969d-396d-48ae-873d-3a87a51c811c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032164 Jun 02 10:26:10.682686 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 550/1094] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:11.054123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:11.054739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:11.061384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:11.061844 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:11.062626 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:11.063068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:11.094408 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:11.094864 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:11.095362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lazy-loading 'fault' on Instance uuid d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:26:11.137181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:11.144667 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-fb05ebc0-ec79-4a3b-a0e5-b2d046e068d3 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 200 len: 1304 microversion: 2.1 time: 0.094439 Jun 02 10:26:11.145228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 545/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:11 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:12.162889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:12.163546 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: d7c40f1c-92aa-46c1-9e87-8a28c73b52f8] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:12.170130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:12.170583 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:12.171394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:12.171846 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:12.185678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] HTTP exception thrown: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Request method failure captured: Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 HTTP/1.1 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimJAv001oWM7CIZok_8_A5sx2qie6mrDUt4KiprQu6SyxrTK5GlKZZKzowYVZm_UBUjPxP9SRiqNEekcPr5jdAPgcGJTHDkrvp3X-ePOvgZHxE_tk3WRTmJMxxTIK6mT4f77WQl9WxLiITLtmfp3UrsYr6gSbLiG9A57VBE0CxEUPE7U Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: e5b8100379874f6da5d5c872d2d3e103 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:26:12.187383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: e5b8100379874f6da5d5c872d2d3e103 Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesActionsTest-2085505569-project Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 70b0e2d2652f462da1e5d5899ce0dee0 Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesActionsTest-2085505569-project Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. Jun 02 10:26:12.188959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'd7c40f1c-92aa-46c1-9e87-8a28c73b52f8'} Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:12.189889 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. Jun 02 10:26:12.191506 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:12.193136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Returning 404 to user: Instance d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:12.193136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e1b1dfd8-1152-4aa2-8641-6870e1e54d13 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8" status: 404 len: 111 microversion: 2.1 time: 0.030846 Jun 02 10:26:12.193136 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 551/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:12 2022] GET /compute/v2.1/servers/d7c40f1c-92aa-46c1-9e87-8a28c73b52f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:12.285752 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-868351414", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "networks": [{"uuid": "4721d5f3-b6c1-4b66-8cdd-bb00151effa8"}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:12.338548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] validate_networks() for [('4721d5f3-b6c1-4b66-8cdd-bb00151effa8', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:26:12.678021 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:26:12.678442 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:26:12.678913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:26:12.679351 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:26:12.679764 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:26:12.688611 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:12.689057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:12.689888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:12.690323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:12.706566 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Getting quotas for project e5b8100379874f6da5d5c872d2d3e103. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:26:12.710375 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Getting quotas for user 70b0e2d2652f462da1e5d5899ce0dee0 and project e5b8100379874f6da5d5c872d2d3e103. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:26:12.721492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:26:12.723754 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:26:12.816822 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7b5c9bed-a214-45cf-aa59-e1c9825bcf67 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534876 Jun 02 10:26:12.817463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 546/1097] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:26:12.827459 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e7929288-3dab-4d03-93ff-1aefb8f953aa tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:12.828078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e7929288-3dab-4d03-93ff-1aefb8f953aa tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:12.884896 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e7929288-3dab-4d03-93ff-1aefb8f953aa tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:12.892394 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e7929288-3dab-4d03-93ff-1aefb8f953aa tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1213 microversion: 2.1 time: 0.068994 Jun 02 10:26:12.892953 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 552/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:12 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:13.910524 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:13.911388 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:13.918394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:13.918910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:13.919742 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:13.920191 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:13.982621 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:13.990259 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-641b3e8e-df57-480b-afde-d8724dbf78bb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1217 microversion: 2.1 time: 0.084162 Jun 02 10:26:13.990868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 547/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:13 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:15.007503 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:15.008195 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:15.015559 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:15.016013 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:15.016753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:15.017190 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:15.080481 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:15.088259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-e3900e3b-6e0b-466a-a0a0-ffbeae3828eb tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1271 microversion: 2.1 time: 0.084596 Jun 02 10:26:15.088831 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 553/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:15 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:16.105954 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:16.106569 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:16.113068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:16.113523 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:16.114295 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:16.114739 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:16.249999 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-408888dd-dbc1-4408-92f1-a02344241a5a req-10eb7e75-7a77-44bb-9a73-c9e28d20721a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c9df27d-9c1b-4cb2-aa75-4bfa8577f395", "tag": "bc30dfd1-0fe4-407b-983f-cda29e261648"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:16.259397 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-408888dd-dbc1-4408-92f1-a02344241a5a req-10eb7e75-7a77-44bb-9a73-c9e28d20721a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:16.262968 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-408888dd-dbc1-4408-92f1-a02344241a5a req-10eb7e75-7a77-44bb-9a73-c9e28d20721a service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:16.272481 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-408888dd-dbc1-4408-92f1-a02344241a5a req-10eb7e75-7a77-44bb-9a73-c9e28d20721a service nova] Creating event network-changed:bc30dfd1-0fe4-407b-983f-cda29e261648 for instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 on hv-cinder-79760 Jun 02 10:26:16.278154 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-408888dd-dbc1-4408-92f1-a02344241a5a req-10eb7e75-7a77-44bb-9a73-c9e28d20721a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033024 Jun 02 10:26:16.279355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 554/1101] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:26:16.307976 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:16.316356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-500990e1-d209-48ee-bdd4-9d7aab2c3c36 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.214422 Jun 02 10:26:16.316937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 548/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:16 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:17.333537 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:17.334241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:17.340925 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:17.341870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:17.342694 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:17.343165 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:17.470502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:17.478077 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ab9ad66b-92c0-4489-b700-3bed58b07225 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.148527 Jun 02 10:26:17.478641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 555/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:17 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:26:18.495304 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:18.495921 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:18.503064 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:18.503555 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:18.504344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:18.504823 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:18.632009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:18.639504 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-92b430ea-1a6d-47f0-b407-49f30bd450f2 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.148226 Jun 02 10:26:18.640068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 549/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:18 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:19.656125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:19.656741 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:19.663243 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:19.663698 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:19.664496 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:19.664943 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:19.667634 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:19.794024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:19.801902 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cb47bc59-89d7-4eb1-bc08-0441e1f38d54 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.149670 Jun 02 10:26:19.802470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 556/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:19 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:20.819067 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:20.819715 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:20.822105 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:20.826847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:20.827331 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:20.828096 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:20.828533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:20.956880 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:20.964253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-62c7c6e1-7919-4c4a-a874-75f22e467ffe tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.149061 Jun 02 10:26:20.964812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 550/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:20 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:21.981389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:21.982010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:21.984472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:21.989370 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:21.993400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:21.993400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:21.993400 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.123978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:22.131489 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-579e90e2-99f8-43fd-934a-f6eb943c44da tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.154103 Jun 02 10:26:22.132270 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 557/1107] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:21 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:22.183697 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:22.184685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:22.191183 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.191644 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.192420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.192866 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.221533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4e884f1e-fbc5-4f28-810b-a5c869b46c69 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041731 Jun 02 10:26:22.222078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 551/1108] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:26:22 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:26:22.278545 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:22.279045 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:22.285018 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.285470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.286240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.286674 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.311194 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:26:22.557514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-37304830-a1e6-499d-a2a3-d5bf2bc65937 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 204 len: 0 microversion: 2.1 time: 0.282524 Jun 02 10:26:22.560750 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 558/1109] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:26:22 2022] DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:26:22.567269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:22.567922 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:22.574127 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.574586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.575405 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.576500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.697895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:22.709400 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:22.717444 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6c824d45-25fa-4d83-9c32-3880de4e80a1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1675 microversion: 2.1 time: 0.154125 Jun 02 10:26:22.718018 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 552/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:22 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:22.731069 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-48f517a0-69a2-4225-bd2c-6d959574e705 req-cd681de3-754e-42c1-b79b-c71bccf8e656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9df27d-9c1b-4cb2-aa75-4bfa8577f395", "name": "network-vif-plugged", "status": "completed", "tag": "bc30dfd1-0fe4-407b-983f-cda29e261648"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:22.739733 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-48f517a0-69a2-4225-bd2c-6d959574e705 req-cd681de3-754e-42c1-b79b-c71bccf8e656 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:22.740179 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-48f517a0-69a2-4225-bd2c-6d959574e705 req-cd681de3-754e-42c1-b79b-c71bccf8e656 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:22.751479 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-48f517a0-69a2-4225-bd2c-6d959574e705 req-cd681de3-754e-42c1-b79b-c71bccf8e656 service nova] Creating event network-vif-plugged:bc30dfd1-0fe4-407b-983f-cda29e261648 for instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 on hv-cinder-79760 Jun 02 10:26:22.756531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-48f517a0-69a2-4225-bd2c-6d959574e705 req-cd681de3-754e-42c1-b79b-c71bccf8e656 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Jun 02 10:26:22.757044 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 559/1111] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:23.148552 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:23.149156 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:23.151303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:23.156834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:23.157678 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:23.158073 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:23.158506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:23.289551 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:23.298060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f0171928-d40b-4f50-8c4f-e72db7f751e4 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.153312 Jun 02 10:26:23.298562 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 553/1112] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:23 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:23.736769 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:23.737472 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:23.739412 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:23.744805 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:23.745259 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:23.746023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:23.746466 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:23.879554 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:23.886998 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a5fc5d07-4404-4e51-afe5-e46bf929e75e tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1675 microversion: 2.1 time: 0.154452 Jun 02 10:26:23.887592 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 560/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:23 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:24.315838 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:24.316465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:24.323422 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:24.323914 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:24.324708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:24.326704 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:24.677705 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:24.685110 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-7487890a-d928-4b21-9614-4c98728e7917 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1313 microversion: 2.1 time: 0.373283 Jun 02 10:26:24.685685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 554/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:24 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:24.905772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:24.906238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:24.913480 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:24.918836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:24.918836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:24.918836 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:24.976641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:24.984306 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3632f454-7962-4ce2-9fdc-fafca48dfca5 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1607 microversion: 2.1 time: 0.083606 Jun 02 10:26:24.984870 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 561/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:24 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1607 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:25.121354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-92b9c41d-bfde-4330-9bc9-b73e55788d1b req-b3b02444-f992-4a87-a23a-0ee98c732dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ede6c0-6e2a-4152-9eaa-ddf55cdb958c", "name": "network-vif-deleted", "tag": "3b579ddf-dbf9-4d50-a205-f2cdb717b2a6"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:25.129184 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-92b9c41d-bfde-4330-9bc9-b73e55788d1b req-b3b02444-f992-4a87-a23a-0ee98c732dcf service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:25.129628 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-92b9c41d-bfde-4330-9bc9-b73e55788d1b req-b3b02444-f992-4a87-a23a-0ee98c732dcf service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:25.141164 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-92b9c41d-bfde-4330-9bc9-b73e55788d1b req-b3b02444-f992-4a87-a23a-0ee98c732dcf service nova] Creating event network-vif-deleted:3b579ddf-dbf9-4d50-a205-f2cdb717b2a6 for instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c on hv-cinder-79760 Jun 02 10:26:25.146129 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-92b9c41d-bfde-4330-9bc9-b73e55788d1b req-b3b02444-f992-4a87-a23a-0ee98c732dcf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028529 Jun 02 10:26:25.146719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 555/1116] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:25.701717 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:25.702371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:25.708475 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:25.708994 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:25.709813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:25.710272 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:25.846970 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:25.854897 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-eb7a6518-8b1c-42dd-976a-98878a1c4429 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1496 microversion: 2.1 time: 0.157055 Jun 02 10:26:25.855525 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 562/1117] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:25 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:26.003114 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:26.003825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:26.010144 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.010600 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.011447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.011889 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.045080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.046766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.046766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lazy-loading 'fault' on Instance uuid 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:26:26.088956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:26.097066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-59a4074c-576c-4deb-92cf-5b55e062309b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 200 len: 1327 microversion: 2.1 time: 0.099277 Jun 02 10:26:26.097631 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 556/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:25 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:26.541563 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:26.542073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:26.548511 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.548967 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.549740 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.550183 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.575073 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:26:26.831458 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4742628e-4993-4fb2-85a0-48b75c28e885 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 204 len: 0 microversion: 2.1 time: 0.293730 Jun 02 10:26:26.832054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 563/1119] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:26:26 2022] DELETE /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:26:26.840109 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:26.840740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:26.846811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.847366 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.848219 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:26.848663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:26.980346 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:26.988420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-db8d8bfa-6ff6-461e-a429-eb4362ed7a65 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1502 microversion: 2.1 time: 0.152139 Jun 02 10:26:26.988994 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 557/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:26 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:27.114282 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:27.115009 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:27.121116 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:27.121563 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:27.122343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:27.122780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:27.135921 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c HTTP/1.1 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:26:27.137501 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:26:27.139708 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '64ede6c0-6e2a-4152-9eaa-ddf55cdb958c'} Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:27.140640 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:26:27.142158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:26:27.143584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:27.143584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-92880dd6-2d13-4b96-b109-41884d2054cd tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 404 len: 111 microversion: 2.1 time: 0.029334 Jun 02 10:26:27.143584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 564/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:27 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:27.148066 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-8d01e3d2-7bf7-452e-8199-8356fcc96a86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '.version_select at 0x7f49ddfa48b0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:27.233761 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8d01e3d2-7bf7-452e-8199-8356fcc96a86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176650193" status: 202 len: 0 microversion: 2.1 time: 0.089443 Jun 02 10:26:27.234327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 558/1122] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 2 10:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176650193 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:26:28.005731 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:28.006565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:28.013468 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:28.013924 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:28.014705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:28.015163 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:28.018269 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-653a4014-1cd0-46ea-a223-e5a2cdff0609 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: .version_select at 0x7f49ddf44280>, body: {"keypair": {"name": "tempest-keypair-727765693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7xJVpNLM2KqTyQbD/YncG5ie2ejsT59TEWdi7WJixsifA6qHR4Y0I3YZ+FJdyHSfdbGdd6ZVii92Nv0JvNAVjZ1Q2F1lGiQ/xU1ZT6VAE3A1RDg5Vy7I0zkNHrWA7+QQ=="}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:28.035503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-653a4014-1cd0-46ea-a223-e5a2cdff0609 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for project 2083731013634acc8fcf98adceb19061. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:26:28.039467 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-653a4014-1cd0-46ea-a223-e5a2cdff0609 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for user 3a59ab67afb940fe96373251e2e80cf6 and project 2083731013634acc8fcf98adceb19061. Resources: {'key_pairs'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:26:28.130250 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-653a4014-1cd0-46ea-a223-e5a2cdff0609 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115780 Jun 02 10:26:28.130851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 559/1123] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 2 10:26:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:26:28.146697 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:28.155113 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-108d958d-9127-49ea-8481-167bf8478219 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1502 microversion: 2.1 time: 0.153236 Jun 02 10:26:28.157263 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 565/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:28 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:28.853305 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-a9c79d07-8355-4b91-9b36-29a63578de52 req-71b6e61d-bbc2-4e1e-bb07-185a00a5bd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c9df27d-9c1b-4cb2-aa75-4bfa8577f395", "name": "network-vif-deleted", "tag": "bc30dfd1-0fe4-407b-983f-cda29e261648"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:28.861956 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-a9c79d07-8355-4b91-9b36-29a63578de52 req-71b6e61d-bbc2-4e1e-bb07-185a00a5bd71 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:28.862397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-a9c79d07-8355-4b91-9b36-29a63578de52 req-71b6e61d-bbc2-4e1e-bb07-185a00a5bd71 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:28.873733 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-a9c79d07-8355-4b91-9b36-29a63578de52 req-71b6e61d-bbc2-4e1e-bb07-185a00a5bd71 service nova] Creating event network-vif-deleted:bc30dfd1-0fe4-407b-983f-cda29e261648 for instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 on hv-cinder-79760 Jun 02 10:26:28.878495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-a9c79d07-8355-4b91-9b36-29a63578de52 req-71b6e61d-bbc2-4e1e-bb07-185a00a5bd71 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029823 Jun 02 10:26:28.879062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 560/1125] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:26:29.173560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:29.174176 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:29.181668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:29.182106 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:29.185766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:29.185766 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:29.216603 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:29.217054 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:29.217505 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.objects.instance [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lazy-loading 'fault' on Instance uuid 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 {{(pid=118066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:26:29.258454 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70b0e2d2652f462da1e5d5899ce0dee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b8100379874f6da5d5c872d2d3e103', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:29.270883 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1084d881-3fe0-4232-8c7e-106f76891020 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 200 len: 1303 microversion: 2.1 time: 0.101696 Jun 02 10:26:29.271504 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 566/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:29 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:30.288753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:30.289393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] [instance: 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:30.296135 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:30.296591 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:30.297388 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:30.297829 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:30.316152 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-355238649", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88316dd4-c8ff-448d-8714-143f519f17d0"}], "security_groups": [{"name": "tempest-securitygroup--797588839"}], "key_name": "tempest-keypair-727765693", "user_data": "}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:30.316702 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] HTTP exception thrown: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Request method failure captured: Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 HTTP/1.1 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimJAv001oWM7CIZok_8_A5sx2qie6mrDUt4KiprQu6SyxrTK5GlKZZKzowYVZm_UBUjPxP9SRiqNEekcPr5jdAPgcGJTHDkrvp3X-ePOvgZHxE_tk3WRTmJMxxTIK6mT4f77WQl9WxLiITLtmfp3UrsYr6gSbLiG9A57VBE0CxEUPE7U Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: e5b8100379874f6da5d5c872d2d3e103 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:26:30.318423 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e5b8100379874f6da5d5c872d2d3e103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: e5b8100379874f6da5d5c872d2d3e103 Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesActionsTest-2085505569 Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesActionsTest-2085505569-project Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 70b0e2d2652f462da1e5d5899ce0dee0 Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesActionsTest-2085505569-project Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. Jun 02 10:26:30.320042 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '3c9df27d-9c1b-4cb2-aa75-4bfa8577f395'} Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:26:30.338984 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. Jun 02 10:26:30.341971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:26:30.343394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] Returning 404 to user: Instance 3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:26:30.343394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a37dce88-ac4b-4ee1-863c-505ae0145872 tempest-VolumesActionsTest-2085505569 tempest-VolumesActionsTest-2085505569-project] 10.222.0.13 "GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395" status: 404 len: 111 microversion: 2.1 time: 0.035887 Jun 02 10:26:30.343394 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 561/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:30 2022] GET /compute/v2.1/servers/3c9df27d-9c1b-4cb2-aa75-4bfa8577f395 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:26:30.423224 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] validate_networks() for [('88316dd4-c8ff-448d-8714-143f519f17d0', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:26:30.900752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:26:30.900752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:26:30.900752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:26:30.900752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:26:30.900752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:26:30.910003 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:30.910461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:30.911309 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:30.911753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:30.928415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for project 2083731013634acc8fcf98adceb19061. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:26:30.932825 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Getting quotas for user 3a59ab67afb940fe96373251e2e80cf6 and project 2083731013634acc8fcf98adceb19061. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:26:30.944203 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:26:30.946510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:26:31.103977 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0ff894a8-dbac-45e8-8127-16dd0091129d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.792156 Jun 02 10:26:31.104637 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 567/1128] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:26:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 02 10:26:31.114744 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-380016a4-1122-4051-b288-0da6448766e8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:31.117579 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-380016a4-1122-4051-b288-0da6448766e8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:31.172332 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-380016a4-1122-4051-b288-0da6448766e8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:31.179038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-380016a4-1122-4051-b288-0da6448766e8 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1236 microversion: 2.1 time: 0.068157 Jun 02 10:26:31.179906 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 562/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:31 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:32.202473 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:32.203015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:32.209066 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:32.209514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:32.210268 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:32.210721 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:32.272330 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:32.279857 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-be8f1a87-51cd-4d62-ac0d-e678b625495d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1240 microversion: 2.1 time: 0.082403 Jun 02 10:26:32.280626 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 568/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:32 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:33.296869 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:33.297496 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:33.304907 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:33.305358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:33.306119 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:33.306558 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:33.371393 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:33.379455 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-33530492-2c2d-4def-938a-d15316ed60bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1240 microversion: 2.1 time: 0.086975 Jun 02 10:26:33.380038 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 563/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:33 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:34.395992 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:34.396610 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:34.403127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:34.404084 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:34.404849 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:34.405287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:34.468418 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:34.476024 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6c3a0de8-2fa9-46bd-b425-65fe4930bd0c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1232 microversion: 2.1 time: 0.083907 Jun 02 10:26:34.476588 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 569/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:34 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:35.493629 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:35.494185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:35.501354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:35.502952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:35.502952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:35.502952 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:35.564041 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:35.571609 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f63121b2-9da8-4e20-8d97-58525cc55b67 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1288 microversion: 2.1 time: 0.081937 Jun 02 10:26:35.572173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 564/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:35 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:36.588180 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:36.588800 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:36.596007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:36.596461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:36.597228 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:36.597678 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:36.669438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:36.679471 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2933cebe-9125-4564-a44b-3ef17441e88a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1294 microversion: 2.1 time: 0.095049 Jun 02 10:26:36.680544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 570/1134] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:36 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:37.697635 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:37.698955 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:37.706925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:37.707463 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:37.708625 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:37.709070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:37.729808 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=100 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:37.886271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-ab2cee15-b953-4fc4-bec6-4b19d48672b3 req-648e998c-f5a6-4465-839d-1faa757b6e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403a59c6-306d-452f-85fe-d3f98c9e890f", "tag": "ff96dea4-b96b-4bd0-9ef2-21db059e7606"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:37.903213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-ab2cee15-b953-4fc4-bec6-4b19d48672b3 req-648e998c-f5a6-4465-839d-1faa757b6e09 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:37.903213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-ab2cee15-b953-4fc4-bec6-4b19d48672b3 req-648e998c-f5a6-4465-839d-1faa757b6e09 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:37.916444 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:37.931324 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:37.946855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-ab2cee15-b953-4fc4-bec6-4b19d48672b3 req-648e998c-f5a6-4465-839d-1faa757b6e09 service nova] Creating event network-changed:ff96dea4-b96b-4bd0-9ef2-21db059e7606 for instance 403a59c6-306d-452f-85fe-d3f98c9e890f on hv-cinder-79760 Jun 02 10:26:37.951720 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2e62cdbf-0adb-4a5e-a7fe-4ec46cf04ab9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.251777 Jun 02 10:26:37.952653 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 565/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:37 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:37.958119 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-ab2cee15-b953-4fc4-bec6-4b19d48672b3 req-648e998c-f5a6-4465-839d-1faa757b6e09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075467 Jun 02 10:26:37.970828 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 571/1136] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:26:38.970124 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:38.970673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:38.978009 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:38.978511 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:38.979347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:38.980086 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:39.129028 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:39.136983 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-02ee1a91-e4b5-4250-b464-d7d3135776ba tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.171453 Jun 02 10:26:39.137574 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 566/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:38 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:40.154238 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:40.154950 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:40.162821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:40.163322 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:40.164343 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:40.164819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:40.310365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:40.318305 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0a0f3b5f-212a-4eca-b75d-575716d0e6c2 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.168254 Jun 02 10:26:40.319199 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 572/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:40 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:41.335080 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:41.335856 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:41.338499 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:41.345986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:41.346664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:41.347584 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:41.348249 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:41.498094 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:41.508992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-59978b34-e760-4798-bde2-09ff4a6abe75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.177688 Jun 02 10:26:41.515695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 567/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:41 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:26:42.525899 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:42.526507 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:42.528467 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:42.529125 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:42.534368 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:42.534813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:42.535598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:42.536029 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:42.665885 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:42.673360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-cbdf2e12-b5d0-446b-b166-d93bf3200f13 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.151365 Jun 02 10:26:42.673928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 573/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:42 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:43.690712 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:43.692062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:43.698925 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:43.699424 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:43.700257 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:43.700692 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:43.865813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:43.879291 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-3ad81e1e-b878-4409-b255-512c2d2d3364 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.192903 Jun 02 10:26:43.880062 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 568/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:43 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:44.887165 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-203e46b6-ccdf-449b-8b2e-9de8a11257da req-2da7ba70-5cb0-411d-923c-d9d3b1e64e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403a59c6-306d-452f-85fe-d3f98c9e890f", "name": "network-vif-plugged", "status": "completed", "tag": "ff96dea4-b96b-4bd0-9ef2-21db059e7606"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:44.898197 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:44.900276 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:44.907478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-203e46b6-ccdf-449b-8b2e-9de8a11257da req-2da7ba70-5cb0-411d-923c-d9d3b1e64e32 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:44.908172 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-203e46b6-ccdf-449b-8b2e-9de8a11257da req-2da7ba70-5cb0-411d-923c-d9d3b1e64e32 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:44.910802 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:44.911612 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:44.913258 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:44.913928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:44.923911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-203e46b6-ccdf-449b-8b2e-9de8a11257da req-2da7ba70-5cb0-411d-923c-d9d3b1e64e32 service nova] Creating event network-vif-plugged:ff96dea4-b96b-4bd0-9ef2-21db059e7606 for instance 403a59c6-306d-452f-85fe-d3f98c9e890f on hv-cinder-79760 Jun 02 10:26:44.930220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-203e46b6-ccdf-449b-8b2e-9de8a11257da req-2da7ba70-5cb0-411d-923c-d9d3b1e64e32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048030 Jun 02 10:26:44.938571 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 574/1142] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:45.121284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:45.130067 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-6a10efdf-76a8-4b19-824c-d0f13d8c8f15 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.237126 Jun 02 10:26:45.130660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 569/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:44 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:46.148669 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:46.149360 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:46.156790 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:46.158934 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:46.159845 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:46.160371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:46.303479 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:46.312138 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-2c705c01-33dc-46e9-af5d-f548a172f842 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1361 microversion: 2.1 time: 0.167460 Jun 02 10:26:46.312860 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 575/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:46 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:26:47.329695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:47.330447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:47.337475 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:47.337997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:47.339024 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:47.339544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:47.475796 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:26:47.484905 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9bae5214-50c2-47a1-ae63-d26a6b2c8e62 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1547 microversion: 2.1 time: 0.159786 Jun 02 10:26:47.485681 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 570/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:26:47 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:26:47.502131 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:26:47.502945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:26:47.511079 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:47.512502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:47.513829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:47.516219 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:47.599367 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-70a45659-6037-4f49-a82c-0457f1ddfeb9 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101494 Jun 02 10:26:47.600220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 576/1146] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 2 10:26:47 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:26:48.970896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-29c1de51-2a52-4e50-ae46-69d658c4f4a5 req-a7bbe95b-2fa7-4081-a8af-6183216c2c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403a59c6-306d-452f-85fe-d3f98c9e890f", "tag": "ff96dea4-b96b-4bd0-9ef2-21db059e7606"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:26:48.981243 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-29c1de51-2a52-4e50-ae46-69d658c4f4a5 req-a7bbe95b-2fa7-4081-a8af-6183216c2c7e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:26:48.981687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-29c1de51-2a52-4e50-ae46-69d658c4f4a5 req-a7bbe95b-2fa7-4081-a8af-6183216c2c7e service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:26:49.002794 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-29c1de51-2a52-4e50-ae46-69d658c4f4a5 req-a7bbe95b-2fa7-4081-a8af-6183216c2c7e service nova] Creating event network-changed:ff96dea4-b96b-4bd0-9ef2-21db059e7606 for instance 403a59c6-306d-452f-85fe-d3f98c9e890f on hv-cinder-79760 Jun 02 10:26:49.009991 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-29c1de51-2a52-4e50-ae46-69d658c4f4a5 req-a7bbe95b-2fa7-4081-a8af-6183216c2c7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043597 Jun 02 10:26:49.011233 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 571/1147] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:07.104662 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccd6fe0b-d7fd-4092-a16b-277e5b7c2606] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 10:28:07.105323 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:07.105911 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=25 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:07.110078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:07.115492 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:07.117287 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:07.117746 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:07.118531 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:07.118976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:07.141970 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7c0fa6c4-11cb-4df0-a6e5-1adeedde393c tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/ips" status: 200 len: 146 microversion: 2.1 time: 0.039051 Jun 02 10:28:07.142533 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 577/1148] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:28:07 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:08.769402 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ddb54f81-364e-425c-924e-73054d70e9cb] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 02 10:28:08.770343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:08.771145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=34 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:08.775462 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ecc7995-6407-4179-b7a6-72bb5b1b04ae"}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:08.776599 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:08.782661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:08.783085 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:08.783863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:08.784303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:09.777017 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] [ddb54f81-364e-425c-924e-73054d70e9cb] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53148. Jun 02 10:28:10.343014 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-068e78e3-8a8f-40d9-a414-c0ec52598ee3 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.575307 Jun 02 10:28:10.343706 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 572/1149] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:28:08 2022] POST /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 194 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:17.822813 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:17.823770 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:17.833090 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:17.833547 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:17.834312 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:17.834752 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:17.839890 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccd6fe0b-d7fd-4092-a16b-277e5b7c2606] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53176. Jun 02 10:28:17.865990 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-8b2041fa-c3ef-4bc5-b52f-e3947351e7e1 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Jun 02 10:28:17.866541 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 578/1150] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:28:17 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:17.877323 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:17.877911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:17.884763 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:17.885212 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:17.885978 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:17.886420 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:17.914772 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c9ddbef5-8656-4f15-ba4e-72b5b0cf6d35 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae" status: 200 len: 194 microversion: 2.1 time: 0.042215 Jun 02 10:28:17.915376 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 573/1151] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 2 10:28:17 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:19.518671 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aceacad-989c-44b8-a9c3-4f89ae143e7b"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:19.519781 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:19.526759 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:19.527240 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:19.528011 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:19.528438 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:20.289569 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0789aa1-eab3-4b22-919b-34188c1e6ff4 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "POST /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774813 Jun 02 10:28:20.290241 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 579/1152] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:28:19 2022] POST /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:27.770344 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:27.776116 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:27.777966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:27.778419 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:27.779211 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:27.779652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:27.808917 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5e122196-5af6-48d8-a635-f5a29a4dab9a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042525 Jun 02 10:28:27.809466 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 574/1153] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:28:27 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:27.947277 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:27.947844 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:27.954158 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:27.954617 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:27.955414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:27.955863 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:27.984598 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-f7fbdda5-fe3c-433f-9ff8-a9481790f050 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae" status: 200 len: 194 microversion: 2.1 time: 0.043102 Jun 02 10:28:27.985164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 580/1154] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 2 10:28:27 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:27.995296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:27.995798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:28.001758 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:28.002210 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:28.002981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:28.003461 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:28.083993 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lazy-loading 'services' on Instance uuid 403a59c6-306d-452f-85fe-d3f98c9e890f {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:28:28.310125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d2d8aad4-9ba6-4fdc-92aa-13adbad11132 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae" status: 202 len: 0 microversion: 2.1 time: 0.318560 Jun 02 10:28:28.310711 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 575/1155] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:28:27 2022] DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/1ecc7995-6407-4179-b7a6-72bb5b1b04ae => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:28:30.474909 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:30.475447 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:30.482023 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:30.482470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:30.483271 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:30.483729 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:30.512423 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-44d15c8e-dc46-4b49-a815-808d35b1e9bc tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/6aceacad-989c-44b8-a9c3-4f89ae143e7b" status: 200 len: 194 microversion: 2.1 time: 0.042231 Jun 02 10:28:30.512989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 581/1156] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 2 10:28:30 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/6aceacad-989c-44b8-a9c3-4f89ae143e7b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:30.523813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:30.524343 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:30.530536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:30.530993 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:30.531793 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:30.532236 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:30.611388 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lazy-loading 'services' on Instance uuid 403a59c6-306d-452f-85fe-d3f98c9e890f {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:28:30.827356 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b3ea4c22-2b1f-49ed-8295-966e679c7348 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/6aceacad-989c-44b8-a9c3-4f89ae143e7b" status: 202 len: 0 microversion: 2.1 time: 0.308170 Jun 02 10:28:30.827967 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 576/1157] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:28:30 2022] DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments/6aceacad-989c-44b8-a9c3-4f89ae143e7b => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:28:31.986120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:31.987683 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:31.994185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:31.994839 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:31.995642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:31.996082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.025775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6070344e-75af-4320-bac5-9916addccf57 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043544 Jun 02 10:28:32.026355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 582/1158] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:28:31 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:28:32.128445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:32.130013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:32.136148 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.136597 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.137380 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.137817 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.165605 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9600041f-e998-4614-b4b4-8cea4e3cd760 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041976 Jun 02 10:28:32.166143 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 577/1159] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 2 10:28:32 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 02 10:28:32.221078 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:32.221514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:32.227711 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.228164 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.228928 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.229364 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.253470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:28:32.590095 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9522b5ea-c423-49c2-a561-1131a10d8859 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 204 len: 0 microversion: 2.1 time: 0.372628 Jun 02 10:28:32.590676 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 583/1160] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:28:32 2022] DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:28:32.599163 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:32.600460 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:32.606272 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.606728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.607537 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:32.607980 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:32.746089 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:28:32.753882 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-d64b28fa-4251-4103-a83b-91d6c5188843 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1672 microversion: 2.1 time: 0.158827 Jun 02 10:28:32.755013 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 578/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:32 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:28:33.773036 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:33.773739 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:33.780144 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:33.780592 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:33.781378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:33.781817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:33.908900 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:28:33.916275 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-918a8b28-1efe-47e1-b863-dfc8d73b3f5d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1672 microversion: 2.1 time: 0.148095 Jun 02 10:28:33.916840 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 584/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:33 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:28:34.936185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:34.936185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:34.941890 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:34.942347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:34.943170 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:34.943622 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:35.163875 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:28:35.172810 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c197ff41-a684-4d11-b8b0-e115ca5c9569 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1672 microversion: 2.1 time: 0.243337 Jun 02 10:28:35.173377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 579/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:34 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1672 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:28:35.591007 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-c94168cf-4418-4454-8499-49dbe0213fac req-4844175e-7f14-4fa5-b98b-bf74b34ae3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403a59c6-306d-452f-85fe-d3f98c9e890f", "name": "network-vif-deleted", "tag": "ff96dea4-b96b-4bd0-9ef2-21db059e7606"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:35.600371 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-c94168cf-4418-4454-8499-49dbe0213fac req-4844175e-7f14-4fa5-b98b-bf74b34ae3a8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:35.605104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-c94168cf-4418-4454-8499-49dbe0213fac req-4844175e-7f14-4fa5-b98b-bf74b34ae3a8 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:35.611561 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-c94168cf-4418-4454-8499-49dbe0213fac req-4844175e-7f14-4fa5-b98b-bf74b34ae3a8 service nova] Creating event network-vif-deleted:ff96dea4-b96b-4bd0-9ef2-21db059e7606 for instance 403a59c6-306d-452f-85fe-d3f98c9e890f on hv-cinder-79760 Jun 02 10:28:35.616985 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-c94168cf-4418-4454-8499-49dbe0213fac req-4844175e-7f14-4fa5-b98b-bf74b34ae3a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030441 Jun 02 10:28:35.617565 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 585/1164] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:28:36.189779 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:36.190398 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:36.197567 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:36.198023 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:36.198804 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:36.199296 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:36.231194 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:36.231649 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:36.232378 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lazy-loading 'fault' on Instance uuid 403a59c6-306d-452f-85fe-d3f98c9e890f {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:28:36.279396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a59ab67afb940fe96373251e2e80cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2083731013634acc8fcf98adceb19061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:28:36.287776 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-bf7f4641-2090-419f-bad7-ab7f7789d98d tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 200 len: 1326 microversion: 2.1 time: 0.101863 Jun 02 10:28:36.288362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 580/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:36 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:28:37.305414 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:37.306112 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:37.312318 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:37.312762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:37.313514 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:37.313945 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:37.326771 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f HTTP/1.1 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:37.331984 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:37.334149 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '403a59c6-306d-452f-85fe-d3f98c9e890f'} Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:37.335185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:37.336772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:37.338223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:37.338223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3ca73431-761b-4a0e-a60b-58ee3049ea86 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 404 len: 111 microversion: 2.1 time: 0.029019 Jun 02 10:28:37.338223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 586/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:37 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:37.338992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-b555c2e2-80ae-4125-a300-b35b58f3b98a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '.version_select at 0x7f49ddcaddc0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:37.437326 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-b555c2e2-80ae-4125-a300-b35b58f3b98a tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727765693" status: 202 len: 0 microversion: 2.1 time: 0.102110 Jun 02 10:28:37.437910 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 581/1167] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 2 10:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727765693 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:28:40.910983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:40.911494 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:40.918150 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:40.918606 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:40.919411 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:40.919854 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:40.933030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f HTTP/1.1 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:40.934562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.936213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '403a59c6-306d-452f-85fe-d3f98c9e890f'} Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:40.937156 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.938395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.940035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:40.940035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-9b2d64af-a861-4ffd-9551-2b60afea82be tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 404 len: 111 microversion: 2.1 time: 0.029571 Jun 02 10:28:40.940035 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 587/1168] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:28:40 2022] DELETE /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:40.944586 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:40.945198 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 403a59c6-306d-452f-85fe-d3f98c9e890f] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:40.947396 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:40.952177 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:40.952624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:40.953377 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:40.953812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:40.958228 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:28:40.967411 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f HTTP/1.1 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:28:40.968997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.970641 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '403a59c6-306d-452f-85fe-d3f98c9e890f'} Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:40.975427 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. Jun 02 10:28:40.976902 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:40.978531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 403a59c6-306d-452f-85fe-d3f98c9e890f could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:40.978531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-790cf959-8c33-47fb-af36-448e96d96b1b tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f" status: 404 len: 111 microversion: 2.1 time: 0.029835 Jun 02 10:28:40.978531 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 582/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:40 2022] GET /compute/v2.1/servers/403a59c6-306d-452f-85fe-d3f98c9e890f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:42.217949 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:42.218452 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:42.225655 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:42.226104 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:42.226866 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:42.227339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:42.240951 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c HTTP/1.1 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:42.242469 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.244105 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '64ede6c0-6e2a-4152-9eaa-ddf55cdb958c'} Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:42.245006 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.246512 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.248303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:42.248303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-aaa9dbf7-e123-4919-9398-c7faa8492c09 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jun 02 10:28:42.248303 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 588/1170] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:28:42 2022] DELETE /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:42.252580 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:42.253204 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] [instance: 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:28:42.261070 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:42.261533 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:42.262322 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:28:42.262764 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:28:42.278660 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] HTTP exception thrown: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Request method failure captured: Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c HTTP/1.1 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimI726HRXQsBeoYp21i_sRZeQd94AWeoLnQ2UdeDIx__CuHB9eX24Opi5lD3wqn98jAyKUedfuLyLwjmv5bzqXD0QTiNQnnUkvpkIXXVjkPr98lpBbdqjmEIeqfeUrzlwg8q9XqGkdNEttpmuoPDnmnKvYC6T-QMTpSQ6Sr0FylJVS9I Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:28:42.280271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2083731013634acc8fcf98adceb19061"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2083731013634acc8fcf98adceb19061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2083731013634acc8fcf98adceb19061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 2083731013634acc8fcf98adceb19061 Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233753830 Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: 3a59ab67afb940fe96373251e2e80cf6 Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-AttachVolumeTestJSON-1233753830-project Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.281981 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '64ede6c0-6e2a-4152-9eaa-ddf55cdb958c'} Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:42.283141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. Jun 02 10:28:42.284749 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:42.286840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] Returning 404 to user: Instance 64ede6c0-6e2a-4152-9eaa-ddf55cdb958c could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:42.286840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5de28e82-68cb-438f-8636-1b954ab71a75 tempest-AttachVolumeTestJSON-1233753830 tempest-AttachVolumeTestJSON-1233753830-project] 10.222.0.13 "GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c" status: 404 len: 111 microversion: 2.1 time: 0.033337 Jun 02 10:28:42.286840 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 583/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:28:42 2022] GET /compute/v2.1/servers/64ede6c0-6e2a-4152-9eaa-ddf55cdb958c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:47.469185 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4c4e2f92-6ac6-429a-a7af-3aa8548bb69f tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Action: 'create', calling method: .version_select at 0x7f49dfa711f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254627414", "metadata": {"Type": "work"}}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4c4e2f92-6ac6-429a-a7af-3aa8548bb69f tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 121 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:47.482413 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-254627414", "metadata": {"Type": "work"}}} Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:28:47.484118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-254627414', 'metadata': {'Type': 'work'}}}} Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise error Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi '#$%' Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.485213 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 10:28:47.486969 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 10:28:47.488959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 02 10:28:47.488959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.488959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-4c4e2f92-6ac6-429a-a7af-3aa8548bb69f tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.488959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-4c4e2f92-6ac6-429a-a7af-3aa8548bb69f tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125640 Jun 02 10:28:47.488959 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 589/1172] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 2 10:28:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:28:47.495082 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9b0c6928-acec-4f06-bf64-3031b9acdcdb tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Action: 'create', calling method: .version_select at 0x7f49e2f9da60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789044389", "metadata": {"Type": "work"}}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9b0c6928-acec-4f06-bf64-3031b9acdcdb tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 119 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:28:47.498387 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789044389", "metadata": {"Type": "work"}}} Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: Jun 02 10:28:47.500103 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-789044389', 'metadata': {'Type': 'work'}}}} Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise error Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi '0' Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.501075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 10:28:47.502447 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 10:28:47.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 02 10:28:47.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9b0c6928-acec-4f06-bf64-3031b9acdcdb tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9b0c6928-acec-4f06-bf64-3031b9acdcdb tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008837 Jun 02 10:28:47.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 584/1173] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 2 10:28:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:28:47.509148 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a5c498d1-46af-4f97-966a-efa17e1fab31 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Action: 'create', calling method: .version_select at 0x7f49ddc7e700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1578732140", "metadata": {"Type": "work"}}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a5c498d1-46af-4f97-966a-efa17e1fab31 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 119 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:47.513728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1578732140", "metadata": {"Type": "work"}}} Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:28:47.515310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1578732140', 'metadata': {'Type': 'work'}}}} Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise error Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi '' Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.516325 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 02 10:28:47.518130 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 02 10:28:47.519553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 02 10:28:47.519553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.519553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a5c498d1-46af-4f97-966a-efa17e1fab31 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.519553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a5c498d1-46af-4f97-966a-efa17e1fab31 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010461 Jun 02 10:28:47.519553 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 590/1174] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 2 10:28:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 02 10:28:47.526937 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-00c60bd8-120c-4161-89ca-b0ded6d3fda6 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Calling method '.version_select at 0x7f49ddc11700>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:47.555728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-00c60bd8-120c-4161-89ca-b0ded6d3fda6 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] HTTP exception thrown: Volume tempest-invalid-22264450 could not be found. Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-00c60bd8-120c-4161-89ca-b0ded6d3fda6 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-22264450 HTTP/1.1 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:28:47.558683 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Volume tempest-invalid-22264450 could not be found. Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'tempest-invalid-22264450'} Jun 02 10:28:47.560317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-22264450 could not be found. (HTTP 404) (Request-ID: req-0681fe7b-6f97-4624-a9da-3b2918966ebf) Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.561306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:28:47.562762 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-22264450 could not be found. Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:47.564128 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-22264450 could not be found. Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-22264450 could not be found. Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-00c60bd8-120c-4161-89ca-b0ded6d3fda6 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 404 to user: Volume tempest-invalid-22264450 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-00c60bd8-120c-4161-89ca-b0ded6d3fda6 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-22264450" status: 404 len: 97 microversion: 2.1 time: 0.038195 Jun 02 10:28:47.565563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 585/1175] 10.222.0.13 () {58 vars in 1211 bytes} [Thu Jun 2 10:28:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-22264450 => generated 97 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 02 10:28:47.572560 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-35f55838-4f10-4405-937d-6c310fcbbe6a tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005924 Jun 02 10:28:47.573483 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 591/1176] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 2 10:28:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 10:28:47.581766 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-8c5dcace-9d53-433f-925b-a94e12004fd1 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003785 Jun 02 10:28:47.582293 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 586/1177] 10.222.0.13 () {58 vars in 1136 bytes} [Thu Jun 2 10:28:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 02 10:28:47.592922 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fb283544-3924-4e59-a51c-a4481e57500b tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Calling method '.version_select at 0x7f49dfa71430>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:47.622664 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-fb283544-3924-4e59-a51c-a4481e57500b tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] HTTP exception thrown: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fb283544-3924-4e59-a51c-a4481e57500b tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: DELETE /compute/v2.1/os-volumes/524c6abc-633a-4f0b-a4e7-24d8aac8829a HTTP/1.1 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:28:47.625278 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': '524c6abc-633a-4f0b-a4e7-24d8aac8829a'} Jun 02 10:28:47.626989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. (HTTP 404) (Request-ID: req-b1205bfb-c658-4ec1-ba02-a437ba82cd20) Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.631623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 02 10:28:47.633286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 02 10:28:47.634743 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-fb283544-3924-4e59-a51c-a4481e57500b tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 404 to user: Volume 524c6abc-633a-4f0b-a4e7-24d8aac8829a could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-fb283544-3924-4e59-a51c-a4481e57500b tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/524c6abc-633a-4f0b-a4e7-24d8aac8829a" status: 404 len: 109 microversion: 2.1 time: 0.040013 Jun 02 10:28:47.636198 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 592/1178] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 2 10:28:47 2022] DELETE /compute/v2.1/os-volumes/524c6abc-633a-4f0b-a4e7-24d8aac8829a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:28:47.637969 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5063a25f-92e5-4fce-8575-6a1070fa7279 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Calling method '.version_select at 0x7f49e2f9d5e0>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:28:47.665482 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-5063a25f-92e5-4fce-8575-6a1070fa7279 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] HTTP exception thrown: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5063a25f-92e5-4fce-8575-6a1070fa7279 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Request method failure captured: Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/os-volumes/b8f7a744-e32e-4299-a072-d34d6b5314f8 HTTP/1.1 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimJDfcsf-zhFVxcdfowDxbXwLiyjxaX06MNGAqDBDP3Z_0OTdfD_3xWiTZIx0kSnyBfKU431XioIbXKGuv9WeNMi4iaK0b6uPCMGvxYizH2tXmfrHdDaY6WsKUCkR21IBByPvMYfa9hW72Hz-J6N2IrZf_dXQFhUWR4pdT1kOBEzgdTU Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:28:47.666942 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ea49471d9514e72a2286bfd207b6d84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 8ea49471d9514e72a2286bfd207b6d84 Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesNegativeTest-1729445640 Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: fcd02635729c48aa970c2598c19ede56 Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesNegativeTest-1729445640-project Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': 'b8f7a744-e32e-4299-a072-d34d6b5314f8'} Jun 02 10:28:47.668544 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. (HTTP 404) (Request-ID: req-f151988e-545a-41b6-9e36-606b76e8d7a7) Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.669491 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 02 10:28:47.670664 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 02 10:28:47.671896 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-5063a25f-92e5-4fce-8575-6a1070fa7279 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] Returning 404 to user: Volume b8f7a744-e32e-4299-a072-d34d6b5314f8 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-5063a25f-92e5-4fce-8575-6a1070fa7279 tempest-VolumesNegativeTest-1729445640 tempest-VolumesNegativeTest-1729445640-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/b8f7a744-e32e-4299-a072-d34d6b5314f8" status: 404 len: 109 microversion: 2.1 time: 0.034126 Jun 02 10:28:47.673071 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 587/1179] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 2 10:28:47 2022] GET /compute/v2.1/os-volumes/b8f7a744-e32e-4299-a072-d34d6b5314f8 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:29:22.905630 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:22.906375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:22.910912 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-429826320", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "networks": [{"uuid": "de87a4ae-c448-4bf6-bdd1-3d9f7ea7416a"}]}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:29:22.961988 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.network.neutron [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] validate_networks() for [('de87a4ae-c448-4bf6-bdd1-3d9f7ea7416a', None, None, None, None, None)] {{(pid=118066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:29:23.550966 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Flavor limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:29:23.551502 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Image limits 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:29:23.551978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Flavor pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:29:23.553960 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Image pref 0:0:0 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:29:23.554373 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.virt.hardware [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:29:23.563159 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:23.563608 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:23.564395 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:23.564826 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:23.581877 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Getting quotas for project 736e2ca9b4c0467bb1a424fa187f05fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:29:23.586010 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.quota [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Getting quotas for user b9fc9578e2ca4c9da1724ad0a22eedb1 and project 736e2ca9b4c0467bb1a424fa187f05fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:29:23.596965 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Going to run 1 instances... {{(pid=118066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:29:23.599495 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:29:23.717652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [c67d7578-e4c8-4950-b3b7-40a3dc9d6fda] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 10:29:24.726853 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [c67d7578-e4c8-4950-b3b7-40a3dc9d6fda] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53726. Jun 02 10:29:24.731267 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b0ba6a8e-eac7-46b6-80ee-073c28b6c718 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.827589 Jun 02 10:29:24.731918 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 593/1180] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:29:24.743888 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:24.744635 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:24.749654 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-87083201-4b9f-4ffa-a3b5-f7976d541211 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:24.750899 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-87083201-4b9f-4ffa-a3b5-f7976d541211 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:24.809181 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-87083201-4b9f-4ffa-a3b5-f7976d541211 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:24.816078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-87083201-4b9f-4ffa-a3b5-f7976d541211 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1218 microversion: 2.1 time: 0.073757 Jun 02 10:29:24.816721 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 588/1181] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:24 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:25.834477 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:25.835137 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:25.841821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:25.842280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:25.843043 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:25.844481 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:25.903693 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:25.910975 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-a1caf998-7122-43bc-aa8a-6a3966e06526 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1222 microversion: 2.1 time: 0.081390 Jun 02 10:29:25.911631 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 594/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:25 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:26.929068 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:26.929698 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:26.936661 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:26.937125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:26.937901 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:26.951125 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:27.258446 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:27.268445 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-374b9f7b-ec66-4397-b1af-3eba16bf61cc tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1278 microversion: 2.1 time: 0.343638 Jun 02 10:29:27.268787 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 589/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:26 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1278 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:28.285691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:28.286958 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:28.293430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:28.293995 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:28.294776 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:28.295252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:28.429352 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:28.436822 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-03a34684-975c-45e4-ab6d-22ce28335ab3 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.154959 Jun 02 10:29:28.442065 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 595/1184] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:28 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:28.934652 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-d74adc9d-ddb2-4434-b319-a2acdbfcfeac req-0fd451ce-cf24-4f7b-97f0-3c792f4048c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a3f246-792a-4be5-a451-ca58ab1a6af5", "tag": "d7540e55-451a-4690-bbfa-42ff078ed9d5"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:29:28.943397 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d74adc9d-ddb2-4434-b319-a2acdbfcfeac req-0fd451ce-cf24-4f7b-97f0-3c792f4048c9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:28.943851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-d74adc9d-ddb2-4434-b319-a2acdbfcfeac req-0fd451ce-cf24-4f7b-97f0-3c792f4048c9 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:28.954662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-d74adc9d-ddb2-4434-b319-a2acdbfcfeac req-0fd451ce-cf24-4f7b-97f0-3c792f4048c9 service nova] Creating event network-changed:d7540e55-451a-4690-bbfa-42ff078ed9d5 for instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 on hv-cinder-79760 Jun 02 10:29:28.959971 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-d74adc9d-ddb2-4434-b319-a2acdbfcfeac req-0fd451ce-cf24-4f7b-97f0-3c792f4048c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029136 Jun 02 10:29:28.960563 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 590/1185] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 02 10:29:29.453772 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:29.454383 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:29.460893 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:29.461342 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:29.462127 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:29.462562 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:29.587710 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:29.595065 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-41245d07-573c-419b-94af-dccabd60a4fa tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.145216 Jun 02 10:29:29.595652 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 596/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:29 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:30.613104 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:30.613809 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:30.620687 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:30.621145 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:30.621911 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:30.622350 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:30.751433 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:30.758863 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-76aa96d0-5534-40bf-a249-4b43a9fdd95c tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.150383 Jun 02 10:29:30.759634 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 591/1187] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:30 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:31.775255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:31.775871 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:31.782653 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:31.783242 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:31.784008 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:31.784450 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:31.915723 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:31.923037 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-3f864281-716d-47f9-bd45-4939e231ab85 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.151691 Jun 02 10:29:31.923619 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 597/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:31 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:32.939903 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:32.940518 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:32.947522 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:32.947974 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:32.952820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:32.952820 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:33.080057 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:33.088245 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-cd87a22f-e13f-4196-a451-8cb58fa0a647 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.152242 Jun 02 10:29:33.088807 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 592/1189] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:32 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:33.794636 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-f4b67cbb-e239-4fc0-aa52-aae918c10cda req-26607b31-7120-4e14-9148-988055e95141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a3f246-792a-4be5-a451-ca58ab1a6af5", "name": "network-vif-plugged", "status": "completed", "tag": "d7540e55-451a-4690-bbfa-42ff078ed9d5"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:29:33.801699 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:33.803015 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=6 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:33.805356 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-f4b67cbb-e239-4fc0-aa52-aae918c10cda req-26607b31-7120-4e14-9148-988055e95141 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:33.805819 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-f4b67cbb-e239-4fc0-aa52-aae918c10cda req-26607b31-7120-4e14-9148-988055e95141 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:33.816675 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-f4b67cbb-e239-4fc0-aa52-aae918c10cda req-26607b31-7120-4e14-9148-988055e95141 service nova] Creating event network-vif-plugged:d7540e55-451a-4690-bbfa-42ff078ed9d5 for instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 on hv-cinder-79760 Jun 02 10:29:33.821642 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-f4b67cbb-e239-4fc0-aa52-aae918c10cda req-26607b31-7120-4e14-9148-988055e95141 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031303 Jun 02 10:29:33.822210 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 598/1190] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:29:34.105975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:34.106517 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:34.113054 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:34.113503 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:34.114279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:34.114713 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:34.267694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:34.275789 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0c2a155b-e579-4b2b-85c9-99e9c65605c7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.173964 Jun 02 10:29:34.276495 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 593/1191] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:34 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:35.293910 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:35.294657 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:35.301170 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:35.301615 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:35.302366 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:35.302804 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:35.432229 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:35.439702 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-b8f51417-705c-4073-bb5f-3b69ec5a4244 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1318 microversion: 2.1 time: 0.150987 Jun 02 10:29:35.440276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 599/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:35 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:36.455966 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:29:36.456500 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:36.458490 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:36.464281 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:36.464728 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:36.465535 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:36.465965 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:36.603302 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:29:36.610708 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-a86f5e56-3fd4-40e0-a182-b0c273ff781e tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1507 microversion: 2.1 time: 0.158649 Jun 02 10:29:36.611301 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 594/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:29:36 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:29:57.190375 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2133067f-9706-4eea-99e1-97ec21f200d1", "device": "/dev/sdb"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:29:57.191981 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:29:57.193982 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:57.194747 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=34 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:29:57.199461 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:57.199917 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:57.200679 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:29:57.201120 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:29:57.961451 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-91426fae-f5f9-4b23-b644-db09e5e81ce7 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "POST /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774884 Jun 02 10:29:57.962051 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 600/1194] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:29:57 2022] POST /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:30:25.495327 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:25.495851 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:25.497743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=16 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:25.498440 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=32 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:25.503078 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:25.503556 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:25.504310 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:25.504743 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:25.583594 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lazy-loading 'services' on Instance uuid a2a3f246-792a-4be5-a451-ca58ab1a6af5 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:30:25.787867 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-0cf79e0f-9586-4351-aa74-6aa13dd0e221 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5/os-volume_attachments/2133067f-9706-4eea-99e1-97ec21f200d1" status: 202 len: 0 microversion: 2.1 time: 0.297123 Jun 02 10:30:25.788928 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 595/1195] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:30:25 2022] DELETE /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5/os-volume_attachments/2133067f-9706-4eea-99e1-97ec21f200d1 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:30:26.895734 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:26.896508 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:26.900573 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:26.901157 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:26.907221 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:26.907672 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:26.908430 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:26.908867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:26.937575 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:30:27.202936 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-d0744c57-75ef-48c4-82ea-848dd321e3eb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 204 len: 0 microversion: 2.1 time: 0.308401 Jun 02 10:30:27.203478 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 601/1196] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:30:26 2022] DELETE /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:30:27.212798 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:27.213506 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:27.220342 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:27.220793 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:27.221834 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:27.222284 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:27.355412 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:27.362953 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-74c1cd49-8ad6-4bfa-914a-a85c56ebd584 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1513 microversion: 2.1 time: 0.154908 Jun 02 10:30:27.363543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 596/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:27 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:28.380737 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:28.381443 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:28.388017 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:28.388470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:28.389256 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:28.389681 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:28.518837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:28.527301 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-482819b2-af08-462a-956a-fee68f3dd94f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1513 microversion: 2.1 time: 0.150798 Jun 02 10:30:28.527867 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 602/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:28 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:29.545510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:29.546415 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:29.552915 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:29.553376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:29.554339 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:29.554780 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:29.627989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:29.636250 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-80021004-2ebf-4060-815a-27b370668769 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 200 len: 1471 microversion: 2.1 time: 0.094721 Jun 02 10:30:29.639205 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 603/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:29 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 1471 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:30:29.646573 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-95af821a-114e-47d1-8560-77b1b5763943 req-df844b5f-8800-420d-a571-9aee61dd6fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a3f246-792a-4be5-a451-ca58ab1a6af5", "name": "network-vif-deleted", "tag": "d7540e55-451a-4690-bbfa-42ff078ed9d5"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:30:29.654624 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-95af821a-114e-47d1-8560-77b1b5763943 req-df844b5f-8800-420d-a571-9aee61dd6fc3 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:29.655016 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-95af821a-114e-47d1-8560-77b1b5763943 req-df844b5f-8800-420d-a571-9aee61dd6fc3 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:29.666279 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-95af821a-114e-47d1-8560-77b1b5763943 req-df844b5f-8800-420d-a571-9aee61dd6fc3 service nova] Creating event network-vif-deleted:d7540e55-451a-4690-bbfa-42ff078ed9d5 for instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 on hv-cinder-79760 Jun 02 10:30:29.671005 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-95af821a-114e-47d1-8560-77b1b5763943 req-df844b5f-8800-420d-a571-9aee61dd6fc3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153081 Jun 02 10:30:29.671640 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 597/1200] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:30:30.653670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:30.654310 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: a2a3f246-792a-4be5-a451-ca58ab1a6af5] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:30.660833 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:30.661283 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:30.662046 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:30.662484 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:30.675376 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.wsgi [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] HTTP exception thrown: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Request method failure captured: Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: request: GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 HTTP/1.1 Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept: application/json Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Accept-Encoding: identity Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Connection: close Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Length: 0 Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Content-Type: application/json Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Host: 10.222.0.13 Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Openstack-System-Scope: None Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: User-Agent: python-urllib3/1.26.9 Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Auth-Token: gAAAAABimJEBjqbm3p3AVXm-44eBhg5_sIS-KvFs4Qh9-rCu11YwoY2dvHpukwOrZKFCqdakiSqhizfp4Rnk1-JAY8Jj12paJVfk8guH_72QA1oe67d3kdni9G7b6mM6q9hLi59_koO06RVFL1ql1ZMLgI5ebVDCHcvtsgawPYG0SXhGPj7ylbM Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Id: None Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Domain-Name: None Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Identity-Status: Confirmed Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Is-Admin-Project: True Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Id: default Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Domain-Name: Default Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Id: 736e2ca9b4c0467bb1a424fa187f05fc Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Role: reader,member Jun 02 10:30:30.676978 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Roles: reader,member Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Id: 736e2ca9b4c0467bb1a424fa187f05fc Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User: tempest-VolumesSnapshotTestJSON-1623765011-project Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Id: default Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Domain-Name: Default Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Id: b9fc9578e2ca4c9da1724ad0a22eedb1 Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: X-User-Name: tempest-VolumesSnapshotTestJSON-1623765011-project Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: method: > Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: exception: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. Jun 02 10:30:30.678762 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: action_args: {'id': 'a2a3f246-792a-4be5-a451-ca58ab1a6af5'} Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:30:30.679821 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. Jun 02 10:30:30.681252 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: ERROR nova.api.openstack.wsgi Jun 02 10:30:30.682536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Returning 404 to user: Instance a2a3f246-792a-4be5-a451-ca58ab1a6af5 could not be found. {{(pid=118066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:30:30.682536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c36cf3c7-a80f-45c1-a782-336545d502d2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5" status: 404 len: 111 microversion: 2.1 time: 0.029006 Jun 02 10:30:30.682536 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 604/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:30 2022] GET /compute/v2.1/servers/a2a3f246-792a-4be5-a451-ca58ab1a6af5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 02 10:30:41.103140 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:41.104026 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:41.108044 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1170718392", "imageRef": "68ace751-80a5-454b-b705-6017b1099fc7", "flavorRef": "452", "networks": [{"uuid": "de87a4ae-c448-4bf6-bdd1-3d9f7ea7416a"}]}} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:30:41.158347 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.network.neutron [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] validate_networks() for [('de87a4ae-c448-4bf6-bdd1-3d9f7ea7416a', None, None, None, None, None)] {{(pid=118067) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 02 10:30:41.500591 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Flavor limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 02 10:30:41.501053 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Image limits 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 02 10:30:41.501539 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Flavor pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 02 10:30:41.501950 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Image pref 0:0:0 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 02 10:30:41.502362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.virt.hardware [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118067) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 02 10:30:41.511358 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:41.511813 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:41.512607 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:41.513046 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:41.530192 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Getting quotas for project 736e2ca9b4c0467bb1a424fa187f05fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 02 10:30:41.534153 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.quota [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Getting quotas for user b9fc9578e2ca4c9da1724ad0a22eedb1 and project 736e2ca9b4c0467bb1a424fa187f05fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118067) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 02 10:30:41.545673 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Going to run 1 instances... {{(pid=118067) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 02 10:30:41.548055 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68ace751-80a5-454b-b705-6017b1099fc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118067) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 02 10:30:41.663662 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [de086592-20a0-41f8-afe7-cf68151b4028] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 02 10:30:42.670614 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [de086592-20a0-41f8-afe7-cf68151b4028] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54044. Jun 02 10:30:42.675271 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9606fdf0-52e4-478f-bc0f-ae435cd2b557 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.574174 Jun 02 10:30:42.676087 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 598/1202] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 2 10:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 02 10:30:42.685661 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-1911127d-4322-4d8e-955b-50d228adcde9 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:42.686276 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-1911127d-4322-4d8e-955b-50d228adcde9 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:42.688807 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:42.689639 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:42.760082 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-1911127d-4322-4d8e-955b-50d228adcde9 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:42.767623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-1911127d-4322-4d8e-955b-50d228adcde9 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1219 microversion: 2.1 time: 0.085648 Jun 02 10:30:42.768611 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 605/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:42 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:43.785436 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:43.786058 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:43.793267 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:43.795123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:43.795123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:43.795123 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:43.861034 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:43.870232 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-57141e31-720f-443b-9c08-6676aa8f03b4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1215 microversion: 2.1 time: 0.089192 Jun 02 10:30:43.870808 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 599/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:43 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:44.889849 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:44.890470 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:44.898617 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:44.899074 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:44.899861 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:44.900297 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:44.960843 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:44.969691 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-ec260705-4d3a-4d0f-96b0-60485f0706e5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1277 microversion: 2.1 time: 0.084105 Jun 02 10:30:44.971658 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 606/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:44 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:45.890370 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-3da657f3-de9e-4ce0-9d45-13d201e1d9f3 req-05300a28-396a-41d4-b733-275a97f878e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31233440-cd72-4eee-87b5-0920dca3a632", "tag": "8cd0af33-b595-4867-be9c-591904fd9489"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:30:45.898543 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-3da657f3-de9e-4ce0-9d45-13d201e1d9f3 req-05300a28-396a-41d4-b733-275a97f878e0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:45.899494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-3da657f3-de9e-4ce0-9d45-13d201e1d9f3 req-05300a28-396a-41d4-b733-275a97f878e0 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:45.910451 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-3da657f3-de9e-4ce0-9d45-13d201e1d9f3 req-05300a28-396a-41d4-b733-275a97f878e0 service nova] Creating event network-changed:8cd0af33-b595-4867-be9c-591904fd9489 for instance 31233440-cd72-4eee-87b5-0920dca3a632 on hv-cinder-79760 Jun 02 10:30:45.915781 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-3da657f3-de9e-4ce0-9d45-13d201e1d9f3 req-05300a28-396a-41d4-b733-275a97f878e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028406 Jun 02 10:30:45.916354 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 600/1206] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:30:45.987177 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:45.987847 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:45.995365 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:45.999239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:45.999239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:45.999239 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:46.126754 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:46.134749 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-64a74f48-c43b-41a7-96bd-14bae8654de2 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.151453 Jun 02 10:30:46.135350 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 607/1207] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:45 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:47.152199 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:47.152912 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:47.159209 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:47.159663 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:47.160428 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:47.160871 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:47.294719 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:47.302206 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-4c9f74be-9653-48fa-96a0-8048fc2c5fa4 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.154660 Jun 02 10:30:47.302797 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 601/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:47 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:48.317855 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:48.318463 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:48.324422 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:48.324879 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:48.325641 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:48.326088 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:48.457416 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:48.465338 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-7ded736f-af09-4a0c-b252-c1cb19260f5f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.151562 Jun 02 10:30:48.465933 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 608/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:48 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:49.482215 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:49.482837 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:49.489620 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:49.490076 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:49.490895 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:49.491403 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:49.620694 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:49.628141 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c8385e9b-cd55-4dbd-8f19-d94e3a2775db tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.149811 Jun 02 10:30:49.628717 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 602/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:49 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:50.644623 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:50.645262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:50.652380 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:50.652837 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:50.653605 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:50.654076 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:50.780124 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:50.787728 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c0885116-599c-4714-9cc9-473198cfeaa5 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.146930 Jun 02 10:30:50.788299 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 609/1211] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:50 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:51.803938 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:51.804548 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:51.806977 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=2 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:51.807753 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell0:SELECT=6 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:51.812410 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:51.818868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:51.818868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:51.818868 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:51.943075 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:51.950465 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c31d8781-b747-48fb-8c5a-a0b66c4338cb tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.150353 Jun 02 10:30:51.953812 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 603/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:51 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:52.165000 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [req-68396590-7f14-4a3f-a41a-65ac84b60b78 req-ffa138d8-66d4-489e-86e2-d7856a333560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31233440-cd72-4eee-87b5-0920dca3a632", "name": "network-vif-plugged", "status": "completed", "tag": "8cd0af33-b595-4867-be9c-591904fd9489"}]} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:30:52.177355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-68396590-7f14-4a3f-a41a-65ac84b60b78 req-ffa138d8-66d4-489e-86e2-d7856a333560 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:52.177355 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [req-68396590-7f14-4a3f-a41a-65ac84b60b78 req-ffa138d8-66d4-489e-86e2-d7856a333560 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:52.184817 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.compute.server_external_events [req-68396590-7f14-4a3f-a41a-65ac84b60b78 req-ffa138d8-66d4-489e-86e2-d7856a333560 service nova] Creating event network-vif-plugged:8cd0af33-b595-4867-be9c-591904fd9489 for instance 31233440-cd72-4eee-87b5-0920dca3a632 on hv-cinder-79760 Jun 02 10:30:52.189898 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [req-68396590-7f14-4a3f-a41a-65ac84b60b78 req-ffa138d8-66d4-489e-86e2-d7856a333560 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028844 Jun 02 10:30:52.190488 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 610/1213] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:30:52.967554 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:52.968160 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:52.974825 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:52.975303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:52.976060 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:52.976492 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:53.103508 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:53.110841 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-9c4810b3-de61-46c9-ace7-64e8f14b428f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.147113 Jun 02 10:30:53.111437 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 604/1214] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:52 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:54.128026 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:54.128726 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:54.130731 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell0:SELECT=2 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:30:54.136777 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:54.137234 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:54.138062 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:54.138510 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:54.270670 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:54.279556 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-c7d5e336-3b4e-458c-88ad-0097ee8f4f3b tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1319 microversion: 2.1 time: 0.155824 Jun 02 10:30:54.280118 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 611/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:54 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:30:55.296362 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:30:55.296975 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:55.303538 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:55.303988 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:55.304750 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:55.305828 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:55.436811 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:30:55.444383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-af4b3d2e-56b1-4028-b53b-aad84dd5e744 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1508 microversion: 2.1 time: 0.151971 Jun 02 10:30:55.444986 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 605/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:30:55 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:30:55.460705 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68edfee0-931e-4d10-aa09-24dbc3f785e9", "device": "/dev/sdb"}} {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:30:55.461842 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:30:55.468286 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:55.468775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:55.469544 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:30:55.469983 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:30:56.123668 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-6fe09e44-896c-4568-9d91-cfa3d56a8ce6 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "POST /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666800 Jun 02 10:30:56.124304 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 612/1217] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 2 10:30:55 2022] POST /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:31:14.539464 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:31:14.540172 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:31:17.939619 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:17.940149 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:17.942089 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:31:17.942740 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG dbcounter [-] [118067] Writing DB stats nova_cell1:SELECT=40 {{(pid=118067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:31:17.947992 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:17.948546 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:17.949253 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:17.949695 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:18.029913 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.objects.instance [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lazy-loading 'services' on Instance uuid 31233440-cd72-4eee-87b5-0920dca3a632 {{(pid=118067) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 02 10:31:18.203785 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-c4feb608-9d7d-41bb-a3cd-d01e8ec65182 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632/os-volume_attachments/68edfee0-931e-4d10-aa09-24dbc3f785e9" status: 202 len: 0 microversion: 2.1 time: 0.268127 Jun 02 10:31:18.204317 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 606/1218] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 2 10:31:17 2022] DELETE /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632/os-volume_attachments/68edfee0-931e-4d10-aa09-24dbc3f785e9 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 02 10:31:19.311255 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_api:SELECT=18 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:31:19.312378 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG dbcounter [-] [118066] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:31:19.320223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:19.320223 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:19.323220 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:19.323676 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:19.324493 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:19.324890 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:19.349753 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Going to try to terminate instance {{(pid=118066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 02 10:31:19.661389 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-20bcec16-9cd0-4a14-9fe3-43033f9ce158 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 204 len: 0 microversion: 2.1 time: 0.351367 Jun 02 10:31:19.661968 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 613/1219] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 2 10:31:19 2022] DELETE /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 02 10:31:19.671724 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:19.672430 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:19.678696 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:19.679173 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:19.679947 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:19.680383 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:20.053494 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.policy [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118067) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:31:20.060909 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-2de4457b-b28a-482d-8d8d-d21e9a02a4f8 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1514 microversion: 2.1 time: 0.393946 Jun 02 10:31:20.061474 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 607/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:31:19 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:31:21.078192 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:21.078891 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:21.085486 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:21.086434 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:21.087260 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:21.087703 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:21.214665 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:31:21.222410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-0376971b-9d8b-40e0-8a90-342a60338870 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1514 microversion: 2.1 time: 0.148435 Jun 02 10:31:21.222976 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 614/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:31:21 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 02 10:31:22.047303 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [req-72efe778-448f-48f6-a34f-ffab7bf3f5be req-d4374807-bb5a-4602-aaa5-0ea3e79b5d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31233440-cd72-4eee-87b5-0920dca3a632", "name": "network-vif-deleted", "tag": "8cd0af33-b595-4867-be9c-591904fd9489"}]} {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 02 10:31:22.056685 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-72efe778-448f-48f6-a34f-ffab7bf3f5be req-d4374807-bb5a-4602-aaa5-0ea3e79b5d26 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:22.057165 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [req-72efe778-448f-48f6-a34f-ffab7bf3f5be req-d4374807-bb5a-4602-aaa5-0ea3e79b5d26 service nova] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:22.068306 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.compute.server_external_events [req-72efe778-448f-48f6-a34f-ffab7bf3f5be req-d4374807-bb5a-4602-aaa5-0ea3e79b5d26 service nova] Creating event network-vif-deleted:8cd0af33-b595-4867-be9c-591904fd9489 for instance 31233440-cd72-4eee-87b5-0920dca3a632 on hv-cinder-79760 Jun 02 10:31:22.074859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [req-72efe778-448f-48f6-a34f-ffab7bf3f5be req-d4374807-bb5a-4602-aaa5-0ea3e79b5d26 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 Jun 02 10:31:22.074859 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 608/1222] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 2 10:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 02 10:31:22.239285 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.api.openstack.wsgi [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:22.240594 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.compute.api [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:22.247829 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:22.248280 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:22.249049 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:22.249497 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG oslo_concurrency.lockutils [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:22.317732 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: DEBUG nova.policy [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9fc9578e2ca4c9da1724ad0a22eedb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '736e2ca9b4c0467bb1a424fa187f05fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 02 10:31:22.325402 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO nova.api.openstack.requestlog [None req-dfb40b94-48e2-4a7a-9ddb-dfedefb50600 tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 200 len: 1304 microversion: 2.1 time: 0.090159 Jun 02 10:31:22.325989 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: [pid: 118066|app: 0|req: 615/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:31:22 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 02 10:31:23.343286 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Calling method '>' {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 02 10:31:23.343997 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.compute.api [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] [instance: 31233440-cd72-4eee-87b5-0920dca3a632] Fetching instance by UUID {{(pid=118067) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 02 10:31:23.350489 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:23.351050 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:23.357536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 02 10:31:23.357536 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG oslo_concurrency.lockutils [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Lock "bb173f29-3e1b-4df6-96a9-19c3d8f141fb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 02 10:31:23.366292 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.wsgi [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] HTTP exception thrown: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Request method failure captured: Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: request: GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 HTTP/1.1 Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept: application/json Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Accept-Encoding: identity Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Connection: close Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Length: 0 Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Content-Type: application/json Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Host: 10.222.0.13 Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Openstack-System-Scope: None Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: User-Agent: python-urllib3/1.26.9 Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Auth-Token: gAAAAABimJEBjqbm3p3AVXm-44eBhg5_sIS-KvFs4Qh9-rCu11YwoY2dvHpukwOrZKFCqdakiSqhizfp4Rnk1-JAY8Jj12paJVfk8guH_72QA1oe67d3kdni9G7b6mM6q9hLi59_koO06RVFL1ql1ZMLgI5ebVDCHcvtsgawPYG0SXhGPj7ylbM Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Id: None Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Domain-Name: None Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Identity-Status: Confirmed Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Is-Admin-Project: True Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Id: default Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Domain-Name: Default Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Id: 736e2ca9b4c0467bb1a424fa187f05fc Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Role: reader,member Jun 02 10:31:23.367979 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Roles: reader,member Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/736e2ca9b4c0467bb1a424fa187f05fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}] Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Id: 736e2ca9b4c0467bb1a424fa187f05fc Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1623765011 Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User: tempest-VolumesSnapshotTestJSON-1623765011-project Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Id: default Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Domain-Name: Default Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Id: b9fc9578e2ca4c9da1724ad0a22eedb1 Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: X-User-Name: tempest-VolumesSnapshotTestJSON-1623765011-project Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: method: > Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: exception: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. Jun 02 10:31:23.369987 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: action_args: {'id': '31233440-cd72-4eee-87b5-0920dca3a632'} Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: {{(pid=118067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 02 10:31:23.371185 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. Jun 02 10:31:23.372632 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: ERROR nova.api.openstack.wsgi Jun 02 10:31:23.374091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: DEBUG nova.api.openstack.wsgi [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] Returning 404 to user: Instance 31233440-cd72-4eee-87b5-0920dca3a632 could not be found. {{(pid=118067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 02 10:31:23.374091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO nova.api.openstack.requestlog [None req-f0a1912a-c94e-480c-bdd5-5ffcdf5bd55f tempest-VolumesSnapshotTestJSON-1623765011 tempest-VolumesSnapshotTestJSON-1623765011-project] 10.222.0.13 "GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632" status: 404 len: 111 microversion: 2.1 time: 0.030853 Jun 02 10:31:23.374091 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: [pid: 118067|app: 0|req: 609/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 2 10:31:23 2022] GET /compute/v2.1/servers/31233440-cd72-4eee-87b5-0920dca3a632 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 02 10:33:29.070775 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:33:29.071410 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:34:34.548908 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:34:34.549584 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:34:49.439847 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:34:49.440381 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Thu Jun 2 10:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:34:49.801138 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:34:49.801628 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:36:21.042384 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:36:21.043026 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Thu Jun 2 10:36:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:36:36.603464 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:36:36.604105 dv-cinder-797608-25-iscsi devstack@n-api.service[118067]: Thu Jun 2 10:36:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 02 10:36:49.079262 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 02 10:36:49.080030 dv-cinder-797608-25-iscsi devstack@n-api.service[118066]: Thu Jun 2 10:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!